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The present invention relates to an image - capturing 
element, an image - capturing circuit for processing an image- 
capture signal provided by an image- capturing element, an 
image-capturing device employing the Image • capturing element 
5 and/or the image - capturing circuit, and a driving method of 
the image -capturing element. 

2 . Description of the Related Art 

When obtaining a black and white image using an image - 

10 capturing element that captures a color image via primary 
color filters, i.e., red (R) , green (G) and blue (B) color 
filters, or via complementary color filters, i.e., cyan (C) , 
magenta (M) and yellow (Y) color filters in the prior art, a 
specific arithmetic operation for colorimetric system 

15 conversion is used on the primary color or complementary 

color element values of the individual pixels constituting 
the color image that has been obtained. In other words, in 
a manner similar to that adopted when achieving a color 
image, the image -capturing element outputs an image -capture 

20 signal and a specific conversion formula is used with a 

signal processing circuit or a signal processing software 
program on the output results to then convert the image - 
capture signal to a black and white image for output. 

For instance, when converting a color image constituted 

25 of R. G and B elements to a black and white image, the color 
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image is converted to a brightness Y in the YIQ colorimetric 
system adopted in the NTSC method. This conversion is 
expressed as ; 

y = 0.299R + 0.587G + 0.114B, 
5 and is achieved by a signal processing circuit or a signal 
processing software program. 

However, when a signal processing circuit converts the 
color image described above to a black and white image, a 
problem arises in that black and white image output cannot 

10 be obtained promptly since the color image -capture signal 
must first undergo A/D conversion to become converted to a 
digital signal, which must then be temporarily stored in 
memory and a significant length of time is required for the 
arithmetic operation in signal processing performed by the 

15 signal processing circuit or in the signal processing 

software to convert the color image to a black and white 
image . 

In particular, in the case of an electronic camera that 
performs such processing, due to the fact that the black and 
2 0 white images cannot be output at high speeds high speed 
continuous photographing (continuous shooting) cannot be 
achieved . 

In addition, in some color electronic cameras employing 
an IT-CCD (interline transfer CCD) , electrical charges 
25 stored at pixels provided vertically adjacent to each other 
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are added to double the electrical charge signal <iuantity- 
This achieves an improvement in sensitivity. 

However, it is necessary to further increase the number 
of pixels to improve the sensitivity by adding the 
5 electrical charges at the pixels while maintaining the 

resolution at a specific level or higher using primary color 
filters i.e., red (R) , green (G) and blue (B) filters and, 
at the same time, an increase in the number of pixels causes 
a problem in that the quantity of electrical charge that can 

10 be handled by each pixel is reduced due to restrictions 
related to the layout of the pixels and the electrical 
charge transfer path resulting in a reduced degree of 
sensitivity and a reduction in the dynamic range of the 
photoelectric conversion - 

15 In addition, there are image -capturing devices having 

color filters with varying spectral transmittance 
characteristics provided at pixels at specific positions < 
which add together the pixel electrical charges and read out 
the results of the addition to obtain a color image using 

20 color filters with complementary color components. 

Furthermore, there are image- capturing devices having 
color filters achieving the same spectral transmittance 
characteristics provided at pixels at specific positions < 
which add together the pixel electrical charges and read out 
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the results of the addition to obtain a color image using 
color filters with primary color components. 

However, a problem exists in that the electrical charge 
quantity that may be handled by a pixel on an image - 
5 capturing element, i.e., by a photoelectric conversion 

element, is within the range between the dark current level 
and the saturation levels and that, with this range greatly 
affecting the dynamic range of the photoelectric conversion 
characteristics, image • capturing cannot be achieved over a 

10 wide dynamic range. 

In this case, even if the spectral transmi ttance 
factors at the color filters are increased to ultimately 
increase the sensitivity by increasing the electrical charge 
^antities, the dynamic range remains unchanged, and also, 

15 even if the spectral transmittance factors at the color 

filters are reduced to lower the sensitivity by reducing the 
electrical charge quantities, the dynamic range itself, 
likewise, remains unchanged. 

In addition, a certain type of correlated double 

20 sampling (CDS) circuit or the like is connected to a two- 
dimensional solid image- capturing element such as a CCD. to 
reduce the reset noise, the output amplifier noise and the 
like of the two-dimensional solid image - capturing element 
included in the output signal from the two-dimensional solid 

25 image -capturing element. 
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In FIG, 25, which illustrates the structure of a. CDS 
circuit in the prior art, the electrical charge thAt has 
undergone photoelectric conversion and has been transferred 
at an image - capturing element 4 01 is output as an image - 
5 capturing signal to a clamp circuit 406 via a buffer 

amplifier 402. The clamp circuit 406 outputs the output 
from the buffer amplifier 402 via a coupling capacitor 403, 
and also applies a voltage provided by a DC voltage source 

405 to the output side of the coupling capacitor 403 by 

10 closing a switch 4 04 with the timing of a timing pulse 0p . 
Thus, the image -capture signal from the coupling capacitor 
d03 is clamped at the field- through level to remove the 
reset noise, the output amplifier noise and the liJce 
mentioned above. 

15 The image- capture signal output from the Clamp circuit 

406 is then output to a sample hold circuit 410 via a buffer 
amplifier 407. The sample hold circuit 410 samples the 
image- capture signal provided by the buffer amplifier 4 07 
using a clamp pulse 0S input to a switch 4 08, and outputs 

20 the level of the signal held at a holding capacitor 4 09 as 
an image-capture signal. Next, the image - capture signal 
indicating the signal level output by the sample hold 
circuit 410 is output via a buffer amplifier 411, is 
subsequently converted to a digital signal et an A/D 
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converter (not shown) and desired image data that have 
undergone various types of signal processing are output. 

Next, in reference to the timing chart in FIGS. 26A 
through 26C, the operation of the CDS circuit in FIG. 25 is 
5 explained. The image -capture signals output by the image- 
capturing element 401 via the buffer amplifier 402 are 
sequentially transferred and output as electrical charge 
signals that are achieved through conversion implemented by 
the individual photoelectric conversion elements at the 

10 image -capturing element 401 as indicated by the waveform of 
the image -capturing element output in FIG. 26A. In the 
image -capturing element output, the electrical charge 
quantity increases in units of pixels after the image- 
capturing element 401 is reset (R) and becomes stabilized at 

15 a signal level LL . After the reset (R) , the clamp pulse a»p 
is applied between a time point ttl and a time point tt2, 
and the image* capturing element output is clamped at a 
field- through level LS that has been applied to match a 
reference level in which the noise is removed. After this, 

20 the signal level LL after clamping is sampled using the 

timing pulse 0S during the time period elapsing from a time 
point tt3 to a time point tt4, and the signal level LL that 
has been held is output as an image - capture signal. In 
other words, the signal level LL relative to the field- 

25 through level LS is output. 
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Now, the output of the image- capturing element may be 
output with the electrical charge signal added at a floating 
diffusion amplifier (FDA) provided at the last stage of the 
image -capturing element to achieve an improvement in the 
5 sensitivity of the electrical charge signal and the like. 

In such a case, two different signal outputs are output 
after a single reset, as illustrated in FIG. 20, which is to 
be detailed later, and a CDS circuit in the prior art 
presents a problem in that since it is capable of sampling 

10 only one electrical charge achieved through addition (or a 
single electrical charge that does not result from 
addition) , the two different output electrical charges 
cannot be utilized effectively. 

in addition, in order to obtain high resolution black 

15 and white (monochrome or monotone) images by employing an 
image -capturing element capable of obtaining color images 
through an image- capturing operation performed via primary 
color filters having color components, green <G) , red (R) 
and blue (B) , various types of interpolation processing are 

20 performed on pixel signals representing the individual color 
components that have been obtained to achieve a black and 
white image output. 

For instance/ a high resolution black and white image 
output is achieved through interpolation processing in which 

2S red (R) pixel signals and blue (B) pixel signals having 



8 



undergone white balance processing are added and averaged or 
only green (G) pixel signalB are used to be add and averaged 
for adjacent pixels in the horizontal and vertical 
directions. 

5 However, the so-called "jaggies" may occur, in which 

fine lines and boundaries of colors in the image become 
jagged due to characteristics of the interpolation 
processing in a high resolution black and white image outpuc 
obtained through the interpolation processing described 

10 above. In addition, jaggies may occur also due to a shift 
in the white balance. In either case, a poor black and 
white image with jaggies is output. 

Furthermore, in order to obtain a high resolution black 
and white image through the interpolation processing 

15 described above, a dedicated signal processing circuit must 
be provided or it is necessary to install a special software 
program to perform the interpolation. The result is an 
increase in the scale of the circuit or an increase in the 
number of installed software programs. In either case, a 

20 great deal of time and effort is required and further 

miniaturization and further reduction in the weight of the 
image -capturing device are hindered. 

SUMMARY OF THE INVENTION 
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The first object of the present invention is to provide 
an image - capturing element in which both color image and 
black and white image can be captured with the identical 
image -capturing element by appropriately adding pixels and 
5 also capturing of black and white images can be performed at 
high speed, and an image -capturing device employing such an 
image -capturing element - 

The second object of the present invention is to 
provide an image -capturing element that has a high 
10 sensitivity and an improved wide dynamic range achieved by 
appropriately adding pixels, and an image - capturing device 
employing such an image - capturing element. 

The third object of the present invention is to provide 
an image -capturing element that can obtain an image - cap ture 
15 signal that has a wide dynamic range achieved by 

appropriately adding pixels or the like, and an image - 
capturing device employing such an image- capturing element. 

The fourth object of the present invention is to 
provide an image -capturing circuit that can efficiently pick 
20 up two kinds of electric charge signals generated with 

addition of pixels at once and process them effectively, and 
an image -capturing device employing such an image -capturing 
circuit . 

The fifth object of the present invention is to provide 
2 5 a driving method of an image - capturing element and an image - 
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capturing device, which make it possible to obtain both a 
color image output and a black and white image output using 
a single image - capturing element by adding together pixels 
in an appropriate manner and to obtain a high resolution, 
5 high quality black and white image with a great degree of 
efficiency through a simple circuit structure - 

In order to attain the above objects, an image- 
capturing element according to the present invention, 

10 comprises: a plurality of pixels provided in a matrix each 

of which has a photoelectric conversion element; a plurality 
of color filters each of which is provided at one of the 
plurality of pixels; and a read out circuit that adds 
together electrical charges of pixels within every specific 

IS range among the plurality of pixels and enables a sequential 
. read out of added electrical charges. 

in order to attain the first object, an image • capturing 
element according to the present invention, comprises: a 
plurality of pixels provided in a matrix each of which has a 

20 photoelectric conversion element. And a green color filter 
is provided at each of 2 x c pixels, a blue color filter is 
provided at each of l x c pixels and a red color filter is 
provided at each of remaining 1 x c pixels within a range of 
4 x c pixels adjacent to each other vertically and 

25 horizontally among the plurality of pixels, the c 
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representing a natural number- And also a read out circuit 
is further provided that adds electrical charges of the 4 x 
c pixels adjacent to each other vertically and horizontally 
and enables a sequential read out of added electrical 
5 charges. 

In this image- capturing element, preferably, the green 
color filter, the blue color filter and the red color filter 
each achieve predefined spectral characteristics to enable 
the read out circuit to read out a brightness signal by 

10 adding together electrical charges of the 4 x c pixels 
adjacent to each other vertically and horizontally. 

In order to attain the first object, an image - capturing 
device according to the present invention comprises: an 
image -capturing element having a plurality of pixels 

15 provided in a matrix each of which has a photoelectric 

conversion element, a green color filter being provided at 
each of 2 X c pixels within a range of 4 x c pixels adjacent 
to each other vertically and horizontally among the 
plurality of pixels, a blue color filter being provided at 

20 each of 1 x c pixels within the range, a red color filter 
being provided at remaining 1 x c pixels within the range, 
and a read out circuit that adds electrical charges at the 4 
x c pixels adjacent to each other vertically and 
horizontally and enables a sequential read out of added 

25 electrical charges; and a drive circuit that provides the 
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read out circuit with a drive signal to enable the read out 
circuit to add electrical charges o£ the 4 x c pixels 
adjacent to each other vertically and horizontally and 
enables a sequential read out of added electrical charges. 
5 It is to be noted that the c represents a natural number 
here 

In this image -capturing device, preferably, the image - 
capturing element has {d x m in a horizontal direction) x {e 
X n in a vertical direction) pixels; and the read out 

10 circuit, in response to the drive signal provided by the 
drive circuit, adds together electrical charges of d x e 
pixels adjacent to each other and enables a read out of {m 
in a horizontal direction) x (n in a vertical direction) 
pixel signals. It is to be noted that the m, n, d and e 

15 represents natural numbers here. Also, preferably, the 

image- capturing device further comprises: a selection unit 
that selects a mode for reading out the (m in a horizontal 
direction) x (n in a vertical direction) pixel signals or a 
mode for reading out the (d x m in a horizontal direction) x 

20 (e X n in a vertical direction) pixel signals without 

adding. Further, preferably, the green color filter, the 
blue color filter and the red color filter each achieve 
predefined spectral characteristics; and the read out 
circuit adds together electrical charges of the 4 x c pixels 
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adjacent to each other vertically and horizontally to read 
out a brightness signal . 

In order to attain the second object, an image - 
capturing element according to the present invention, 
5 comprises: a plurality of pixels provided in a matrix each 
of which has a photoelectric conversion element. And color 
filter* of a single color are provided at each group of a 
^3 specific number of pixels lying adjacent to each other among 

t ij the plurality of pixels; and a read out circuit is provided 

S pi 

10 that adds together electrical charges of the specific number 
of pixels lying adjacent to each other and sequentially 
reads out added electrical charges. 
1,^ In order to attain the second object, an image- 

V:2, capturing device comprises; an image - capturing element 

15 having a plurality of pixels provided in a matrix each of 

which has a photoelectric conversion element, color filters 
Of a single color being provided at each group of a specific 
number of pixels lying adjacent to each other among the 
plurality of pixels, and a read out circuit that adds 

20 together electrical charges of the specific number of pixels 
lying adjacent to each other and enables a ssQuential read 
out of added electrical charges; and a drive circuit that 
provides the read out circuit with a drive signal to enable 
the read out circuit to add together electrical charges of 

25 the specific number of pixels lying adjacent to each other 



14 



and enables a sequential read out of added electrical 
charges . 

In this image -capturing, preferably, the image- 
capturing element has (d x m in a horizontal direction) x (e 
5 X n in a vertical direction) pixels; and the read out 

circuit, in response to the drive signal provided by the 
drive circuit, adds together electrical charges of d x e 
pixels adjacent to each other for a read out and enables a 
r«ad out of (m in a horizontal direction) x (n in a vertical 
10 direction) pixel signals. It is to be noted that the m, n, 
d and e represent natural numbers 

Also, preferably, the image-capturing device further 
i^s, comprises: a selection unit that selects a mode for reading 

out the <m in a horizontal direction) x <n in a vertical 
^ 15 direction) pixel signals or a mode for reading out the (d x 

m in a horizontal direction) x (e x n in a vertical 
direction) pixel signals without adding. 

In order to attain the third object, an Image - capturing 
element according to the present invention comprises: a 
2 0 plurality of pixels provided in a matrix each of which has a 
photoelectric conversion element; and a plurality of color 
filters each of which is provided at one of the plurality of 
pixels. And, among the plurality of color filters, color 
filters of a single color are provided for pixels within 
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each specific range and the color filters within the 
specific range have different transmia sivl ties . 

In this image - capturing element, preferably ^ the color 
filters of the single color having different 
5 transmissivi ties from each other are provided adjacent to 
each other. 

Also, preferably, pixels at which the color filters of 
the single color have different transmissivities have 
identical spectral characteristics. 

10 In order to attain the third object, an image - capturing 

device according to the present Invention, comprises: an 
image - capturing element having a plurality of pixels 
provided in a matrix each of which has a photoelectric 
conversion element, and a plurality of color filters being 

15 provided at the plurality of pixels respectively. The color 
filters are of a single color within each specific range, 
and the color filters within the specific range have 
different transmissivities. And the image -capturing element 
further has a read out circuit that adds together electrical 

2 0 charges of the pixels within the specific range and enables 
a sequential read out of added electrical charges. The 
image- capturing device further comprises a drive circuit 
that provides the read out circuit with a drive signal to 
enable the read out circuit to add together electrical 
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charges of the pixels within the specific range and enables 
a sequential read out of added electrical charges. 

In this image- capturing device, preferably, the color 
filters of the single color having different 
5 transmissivities are provided adjacent to each other; and 
the read out circuit adds together electrical charges 
corresponding to color filters of the single color having 
different transmissivi ties and reads out added electrical 
charges . 

10 Another image- capturing device comprises: an image- 

capturing element having a plurality of pixels provided in a 
matrix each of which has a photoelectric conversion element, 
and a plurality of color filters being provided at the 
plurality of pixels respectively. The color filters are of 

15 a single color within each specific range and the color 
filters within the specific range have different 
transmlssivities . The image- capturing element further 
having a read out circuit that enables a se<auential read out 
of electrical charges of the pixels. The image - capturing 

20 device further comprises a drive circuit that provides the 
read out circuit with a drive signal to sequentially read 
out the electrical charges of the pixels within the specific 
range independently of each other. 

Yet another image - capturing device according to the 

25 present invention comprieee: an image • capturing element 



17 



having a plurality of pixels provided in a matrix pattern 
each of which has a photoelectric conversion element, a 
plurality of color filters being provided at the plurality 
of pixels respectively f and a read out circuit that enables 
5 a sequential read out of electrical charge signal* of the 
pixels; a drive circuit that provides the read out circuit 
with a drive signal to enable the read out circuit to add 
electrical charge signals obtained from pixels with color 
filters thereof lying adjacent to each other, being of a 

10 single color and having the same transmlssivi ty and then to 
enable a read out of added electrical charge signals, and 
also to enable the read out circuit to independently read 
out electrical charge signals obtained from the pixels with 
color filters thereof lying adjacent to each other, being of 

15 a single color and achieving different transmissivi ties 

without adding the electrical charge signals together; and a 
signal processing device that converts signals obtained from 
adjacent single color pixels with different transmissivi ties 
to one brightness signal by synthesizing the signals while 

20 ensuring that the signals continuously change in 
correspondence to an incident light quantity. 

Preferably, this image - capturing device further 
comprises: a selection unit that selects a first mode or a 
second mode. when the first mode is selected, the drive 

25 circuit provides the read out circuit with a drive signal to 
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enable the reed out circuit to add electrical charge signals 
obtained from pixels with color filters thereof lying 
adjacent to each other being of a single color and having 
the same transtnissivi ty and then to read out added 
5 electrical charge signals and also to enable the read out 
circuit to enable reading out electrical charge signals 
obtained from pixels with color filters thereof lying 
adjacent to each other being of a single color and having 
different transmisslvities independently of each other 

10 without performing addition. When the second mode is 

selected, the drive circuit provides the read out circuit 
with a drive signal to enable the read out circuit to 
generate a first added signal by adding together the 
electrical charge signals obtained from the pixels with the 

15 color filters thereof lying adjacent to each other being of 
a single color and having the same transmissivity, to enable 
the read out circuit to generate a second added signal by 
adding together the electrical charge signals obtained from 
the pixels with the color filters thereof lying adjacent to 

20 each other being of a single color and having different 

transmisslvities, and also to enable the read out circuit to 
add the first added signal and the second added signal and 
enable a read out of an addition signal of the first added 
signal and the second added signal. When the second mode is 
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selected, the signal processing device stops synthesizing 
processing . 

In order to attain the fourth object, an image- 
capturing circuit according to the present invention is an 
5 image - capturing circuit for . processing a signal provided by 
a solid image -capturing element. The solid image - capturing 
element has a pixel matrix which includes a plurality of 
pixels provided in a matrix each of which has a 
photoelectric conversion element. The solid image- capturing 

10 element reads out electrical charge signals from the pixel 
matrix by vertically transferring and horisontally 
transferring the electrical charges and adds together 
electrical charges of a plurality of pixels lying adjacent 
to each other in a horizontal direction in a horizontal 

15 transfer output. The image -capturing circuit comprises: a 
clamp circuit that clamps a feed through level of an output 
signal from the solid image-capturing element at a constant 
potential; and a plurality of sample hold circuits that 
sample and hold an output signal from the clamp circuit over 

20 a plurality of different periods. 

In order to attain the fourth object, an image- 
capturing device according to the present invention 
comprises: an image - capturing optical system; a solid image - 
capturing element having a pixel matrix with a plurality of 

25 pixels provided in a matrix each of which has a 
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photoelectric conversion element. The plurality of pixels 
receive an image light of a subject via the image- capturing 
optical system. The solid image - capturing element reads out 
electrical charge signals from the pixel matrix by 
5 vertically transferring and horizontally transferring the 
electrical charge signals and adds together electrical 
charge signals of a plurality of pixels adjacent to each 
other in the horizontal direction in a horizontal transfer 
output. The image- capturing device further comprises: a 

10 clamp circuit that clamps a feed through level of an output 
signal from the solid image- capturing element at a constant 
potential; a plurality of sample hold circuits that sample 
and hold an output signal from the clamp circuit over a 
plurality of different periods; and a drive circuit that 

15 provides the clamp circuit and the sample hold circuits with 
a drive signal. 

In this image- capturing device, preferably, the pixel 
matrix has color filters of a single color for every four 
pixels adjacent to each other vertically and horizontally; 

20 the solid image - capturing element sequentially outputs an 
electrical charge signal at one of two pixels adjacent to 
each other in the horizontal direction and an added 
electrical charge signal achieved by adding together 
electrical charge signals of the two pixels adjacent to each 

25 other in the horizontal direction; and the plurality of 
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sample hold circuits include two sample hold circuits, one 
for sampling and holding the electrical charge eignal of one 
of the two pixels and another for sampling and holding the 
added electrical charge signal achieved by adding together 
5 the electrical charge signals of the two pixels. 

Also, preferably, the image - capturing device further 
comprises: a switching circuit for selectively inputting an 
output of the clamp circuit to the plurality o£ sample hold 
circuits . 

10 Also, preferably, the plurality of frainple hold circuits 

are commonly connected to an output of the clamp circuit, 
sample an output of the clamp circuit during different time 
periods from each other and output in parallel a signal 
achieved by adding together electrical charge signals at a 

15 plurality of pixels of a single color adjacent to each other 
in the horizontal direction and a signal achieved without 
addi tion . 

Also, preferably, the image - capturing device further 
comprises: a selection unit that selects a mode for 
20 outputting a electrical charge signal at one of two pixels 

adjacent to each other in the horizontal direction or a mode 
for outputting an added signal electrical charge achieved by 
adding together signal electrical charges at the two pixels 
adjacent to each other in the horizontal direction. 
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In order to attain the fifth object, a driving method 
according to the present invention is used for an image- 
capturing element that. has 2 x a x m pixels along a 
horizontal direction and 2 x b x n pixels along a vertical 
5 direction arranged in a matrix. Each pixel has a 

photoelectric conversion element, the image capturing 
element has a color filter array in which color filters of a 
single color are arranged at every first pixel group that 
has 2 X a pixels along a horizontal direction and 2 x b 

10 pixels along a vertical direction adjacent to each other, a 
color arrangement of the color filters at every first pixel 
group achieves a Bayer array, and the a, b, m and n each 
representing a natural number. The driving method 
comprises; a step in which either a color image mode or a 

15 monochrome image mode is selected; a step in which driving 
of the image -capturing element is implemented to add 
together individual pixels in the first pixel group for 
readout when the color image mode is selected; and a step in 
which driving of the image- capturing element is implemented 

20 to add together individual pixels in an second pixel group 
achieved by shifting by "a" pixels in the horizontal 
direction and by "b" pixels in the vertical direction 
relative to a position of the first pixel group for readout 
when the monochrome image mode is selected. 
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Another driving method according to the present 
invention is used also for an image -capturing element that 
has a plurality of pixels arranged in a matrix. Each pixel 
has a photoelectric conversion element, the image capturing 
5 element has a color filter array in which color filters of a 
single color are arranged at every four pixels adjacent to 
each other in vortical and horizontal directions, a color 
arrangement of the color filters at every the four pixels 
achieves a Bayer array. The driving method comprises: a 

10 step in which either a color image mode or a monochrome 
image mode is selected; a step in which driving of the 
image -capturing element is Implemented to add together the 
four pixels for readout when the color image mode is 
selected; and a step in which driving of the image - capturing 

15 element is implemented to add together other four pixels 
achieved by shifting by one pixel in the horizontal 
direction and by one pixel in the vertical direction 
relative to a position of the four pixels for readout when 
the monochrome image mode is selected. 

2 0 An image -capturing device according to the present 

invention comprises: an image- capturing element that has 2 x 
a X m pixels along a horizontal direction and 2 x b x n 
pixels along a vertical direction arranged in a matrix. 
Each pixel has a photoelectric conversion element, the image 

25 capturing element has a color filter array in which color 
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filters of a single color are arranged at every first pixel 
group that has 2 x a pixels along a horizontal direction and 
2 X b pixels along a vertical direction adjacent to each 
other, a color arrangement of the color filters at every 
5 first pixel group achieves a Bayer array, and the a, m 
and n each representing a natural number. The image- 
capturing device further comprises; a switching device that 
selects either a color image mode or a monochrome image 
mode; and a drive control device that implements drive 

10 control of the image - capturing element to add together 

individual pixels in the first pixel group for readout when 
the color image mode is selected, and implements drive 
control of the image -capturing element to add together 
individual pixels in an second pixel group achieved by 

15 shifting by "a" pixels in the horiizontal direction and by 

"b" pixels in the vertical direction relative to a position 
of the first pixel group for readout when the monochrome 
image mode is selected. 

This image- capturing device preferably further 

2 0 comprises: a color image generating device that generates 
color image information by using an output signal from the 
image -capturing element when the color image mode is 
selected; and a monochrome image generating device that 
generates monochrome image information by using an output 
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signal from the image - capturing element when the monochrome 
image mode is selected. 

Another image - capturing device according to the present 
invention also comprises; an image ■ capturing element that 
5 has a plurality of pixels arranged in a matrix. Each pixel 
has a photoelectric conversion elements the image capturing 
element has a color filter array in which color filters of a 
single color are arranged at every four pixels adjacent to 
each other in vertical and horizontal directions, a color 

10 arrangement of the color filters at every the four pixels 
achieves a Bayer array. And the image- capturing device 
further comprises: a switching device that selects either a 
color image mode or a monochrome image mode; and a drive 
control device that implements drive control of the image - 

15 capturing element to add together the four pixels Cor 

readout when the color image mode is selected, implements 
drive control of the image -capturing element to add together 
other four pixels achieved by shifting by one pixel in the 
horizontal direction and by one pixel in the vertical 

20 direction relative to a position of the four pixels for 
readout when the monochrome image mode is selected. 

BRIEF DESCRIPTION OP THE DRAWINGS 
FIG- 1 illustrates the structure of the image - capturing 
25 element in a first embodiment of the present Invention; 
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FIG. 2 illustrates th« principle of obtaining a black 
and white image through addition in a color pixel matrix; 

FIG. 3 illustrates a black and white image obtained 
through addition in a color pixel matrix; 
5 FIG. 4 is a block diagram illustrating the structure of 

an electronic camera employing the image - capturing element 
illustrated in FIG. 1; 

PIG. 5 is a schematic plan view of the electronic 
camera in FIG. 4; 
10 FIG. 6 illustrates the structure of the image - capturing 

element in a second embodiment of the present invention: 

FIG. 7 illustrates the principle o£ obtaining a high 
sensitivity image through addition in a color pixel matrix; 

PIO. 8 illustrates a high sensitivity image obtained 
15 through addition in a color pixel matrix; 

FIG. 9 illustrates the structure of the image - capturing 
element in a third embodiment of the present invention; 

FIG. 10 illustrates the principle of obtaining a signal 
with a high sensitivity and a wide dynamic range achieved 
20 through signal synthesis in a color pixel matrix; 

FIG. 11 illustrates a high sensitivity image with a 
wide dynamic range achieved through signal synthesis in a 
color pixel matrix; 

FIG. 12A illustrates the photoelectric conversion 
25 characteristics corresponding to individual pixels; 
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FIG. 2 illustrates the principle of obtaining a black 
and white image through addition in a color pixel matrix; 

FIG. 3 illustrates a black and white image obtained 
through addition in a color pixel matrix; 
5 FIG. 4 is a block diagram Illustrating the structure of 

an electronic camera employing the image - capturing element 
illustrated In FIG. 1; 
hj PIG. 5 is a schematic plan view of the elecrronic 

camera in FIG. 4; 

i ij 

10 FIG. 6 illustrates the structure of the image- capturing 

element in a second embodiment of the present inven .ion; 

I y 

FIG. 7 illustrates the principle of obtaining . high 
sensitivity image through addition in a color pixel matrix; 
FIO. 8 illustrates a high sensitivity image ob alned 
IS through addition in a color pixel matrix; 
■•,3 FIG. 9 illustrates the structure of the image - , apturing 

element in a third embodiment of the present invention; 

FIG. 10 illustrates the principle of obtaining a signal 
with a high sensitivity and a wide dynamic range achieved 
20 through signal synthesis in a color pixel matrix; 

FIG. 11 illustrates a high sensitivity image with a 
wide dynamic range achieved through signal synthesis in a 
color pixel matrix; 

FIG. 12A illustrates the photoelectric conversion 
25 characteristics corresponding to individual pixels; 
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FIG. 12B illustrates the photoelectric conversion 
characteristics achieved through synthesis of signals of 
pixels having various transmissivi ties ; 

FIG. 13 illustrates an example of a pixel array mode 
5 that may be adopted within a color pixel group; 

FIG. 14 illustrates an example of a pixel array mode 
that may be adopted when the transmissivi ties of all the 
pixels within the color pixel group are varied; 

FIGS. 15A and 15B illustrate the photoelectric 
10 conversion characteristics with a wide dynamic rang ; 

achieved through signal synthesis when the tranemis ivities 
of all the pixels within the color pixel group are - aried; 

FIG. 16 illustrates the structure of the image 
capturing element in a variation of the third embod; iient; 
15 FIG. 17 illustrates an example of a pixel arra^ mode in 

a color pixel group in the variation illustrated in ^IG. 16; 

FIG. 18 illustrates the matrix of addition plx& s with 
a wide dynamic range achieved through signal synthesis in a 
color pixel matrix ; 
20 FIG. 19 illustrates the structure of the CDS circuit in 

a fourth embodiment of the present invention; 

FIGS. 20A through 20D are timing charts illustrating 
the operation of Che CDS circuit in PIG. 19; 

FIG. 21 illustrates the structure of an image- capturing 
25 element; 
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FIG. 22 illustrates a mode for arraying individual 
pixels in a color pixel group and the resulting addition 
pixel ; 

FIG. 23 illustrates the structure of variation 1 of the 
5 CDS circuit; 

FIG. 24 illustrates the structure of variation 2 of the 
CDS circuit; 

ij FIG. 25 illustrates the structure of a CDS circuit in 

the prior art; 

10 PIOS. 26A through 2 6C are operational timing c*'.arts of 

!;H the CDS circuit in the prior art; 

=:= FIG. 27 is a flowchart of the switching contro: for the 

Is, photographing mode; 

FIG. 28 is a flowchart of the switching control for the 
15 photographing mode: and 
=3 FIG. 29 is a flowchart of tha switching control for the 

photographing mode . 

FIG. 30 Illustrates the structure of the image - 
capturing element in a fifth embodiment Of the present 
2 0 invention; 

FIG. 31 illustrates the principle through which a color 
image is achieved by adding together the electrical charges 
in color pixel groups; 
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and white images by performing appropriate addition of 
pixels . 

FIG. 1 illustrates the structure of the image - capturing 
element in the first embodiment. An image - capturing element 
5 10 constitutes a color pixel matrix achieved by arraying a 
plurality of pixels 1, i.e., 2m pixels 1 in the horizontal 
direction (the direction of rows) and 2n pixels 1 in the 
vertical direction (the direction of columns) . The color 
pixel matrix, which is achieved through an RGB Bayer array 

10 of R, G and B color pixels, is constituted Of a plurality of 
color pixel groups 6, m of which are provided in the 
horizontal direction and n of which are provided in the 
vertical direction. Each color pixel group 6 in the RGB 
Bayer array is constituted of 2 x 2 pixels, i.e., 4 pixels 

15 1, and in the color pixel group, a G color pixel, an R color 
pixel, a B color pixel and a G color pixel are provided 
adjacent to each other at the first row / first column, at 
the first row / second column, at the second row / first 
column and at the second row / second column respectively, 

20 for instance. The pixels 1, each having a photoelectric 

conversion element such as a photodiode, function as an R, G 
or B color pixel, and this function is achieved by providing 
a color filter that allows R, G or B light to be transmitted 
on the upper surface of each pixel 1. Consequently, the 

25 pixel 1 at the first row / first column, for instance, only 
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allows G (green) light to b« transmitted, and receives only 
the G light component to perform photoelectric conversion on 
it^ It iB to be noted that n and m are natural numbers. 

It is to he noted that a pixel, as referred to in the 
5 context, represents a conceptual pixel that includes a 
photoelectric conversion element such as a photodiode, a 
storage portion for storing the electrical charge generated 
by the photoelectric conversion element and the color filter 
described above. For instance, the image -capturing element 
Ej 10 10 may be constituted of a CCD solid image -capturing 

element. 

When the image - capturing element 10 captures a color 
image, i.e., when the photographing mode in the electronic 
camera is set in the color mode (the photographing mode is 
::f 15 to be detailed later) , the electrical charges stored at the 

^3 individual pixels 1 in the vertical direction are output in 

synchronization to vertical transfer circuits 2, and the 
electric charges output to the vertical transfer circuits 2 
are sequentially transferred in synchronization to a 
20 horisontal transfer circuit 3 in units of single stages of 
electrical charges corresponding to the pixels 1 in the 
horizontal direction. Xn other words, the electric charges 
output to the vertical transfer circuits 2 are sequentially 
transferred in synchronization to a horizontal transfer 
25 circuit 3 stage by stage per electrical charges 
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corresponding to the pixels 1 in the horizontal direction. 
The horizontal transfer circuit 3, in turn, transfers and 
outputs the electrical charges corresponding to the pixels 1 
provided in the horizontal direction via an output aonplifier 
5 4 as an output signal 5 one by one until all the electrical 
charges stored at the pixels 1 are taken out. Thus, since 
the series of electrical charges output as the output signal 
5 achieves regularity whereby it is output in a repetitive 
■f manner with electrical charges corresponding to B, b, 

S 10 G, ... pixels, output at the first stage, electri-*al 

in charges corresponding to G, R, O, R, ... pixels o itput at 

l.'O 

lifi the next stage and electrical charges correspondii: r to B. G, 

B/ G. . . . pixels output at the following stage ur il 
electrical charges corresponding to G, R, G, R, ... pixels 

i;5 15 are output at the last stage, an R G B color image. 

;= corresponding to the array of the color pixel grorps 6 is 

generated. 

In particular, by adopting such an RGB Bayer array, the 
conversion from the RGB colorimetric system to the YIQ 

20 colorimetric system adopted in the NTSC method is 

facilitated. In other words, the YIQ colorimetric system, 
which is expressed using the brightness Y and color 
differences I and Q corresponding to the black and white 
image, achieves the following conversion relationship with 

25 the RGB colorimetric system- Namely, 
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Y - 0.299 R + 0.587 G + 0.144 B 
I - 0.596 R - 0.274 O • 0.322 B and 
Q = 0.211 R - 0,522 G + 0.311 B; 
and the color differences I and Q may be further transformed 
5 as follows; 

I « 0.596 (R - G) 1- 0.322 (G - B) , and 
Q " 0.211 (R - G) - 0.311 (G - B) 
ij- Thus, as long as the differences between R and G and between 

~ G and B can be calculated, the color differences 1 and Q can 

10 be determined with e^ise. Since the B and G are provided 
iiy adjacent to each other and G and R are provided adjacent to 

= each other within a color pixel group 6 and they are 

j- transferred and output adjacent to each other in the RGB 

1'^ Bayer array, the calculation mentioned above can be 

;q 15 performed with ease. 

''Z Now, when the image - capturing element 10 is to capture 

a black and white image as characterized in the present 
invention* i.e., when the photographing mode in the 
electronic camera is set to the black and white mode, the 
20 electrical charges stored at the four individual pixel 

within each color pixel group 6 are added together on the 
image ■ capturing element 10 so that the output signal 5 which 
adopts a mode in which single electrical charges, each 
achieved through such addition of the electrical charges at 
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a coior pixel group are sequentially transferred adjacent to 
each other. 

In addition, the spectral characteristics of the 
individual R, G and B color filters are set to ensure that 
5 the outputs of the individual color components of the four 
pixels in each color pixel group 6 achieves a ratio in which 
a ratio of ((the 1 R pixel) ; (the 2 G pixels) : (the 1 B 
pixel)) equals to a ratio of (0.299 : 0.587 : 0.144). 
Consequently, with the electrical charge achieved through 
id 10 the addition performed within each color pixel group 6 

i;n corresponding to the brightness Y in the yiQ colorimetric 

system, a brightness (Y) signal corresponding to the 
■j arrangement of color pixel groups 6 is output as the output 

M signal 5 from the image - capturing element 10, and addition 

i:% 15 pixels 8 in the m x n matrix indicate the individual pixels 

"•^ of the black and white image (see FIG. 3) . 

In this case, since the electrical charge quantity at 
each addition pixel 8 is larger than the electrical charge 
quantities at individual single pixels, a blacJt and white 
20 image with a high degree of sensitivity can be obtained. 
Now, the following modes may be adopted for the 
addition performed on the image • capturing element 10. An 
explanation is given on them in reference to FIGS, l and 2. 
In the first mode, two pixels la and lb (G and B) 
25 adjacent to each other along the longitudinal column within 
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the color pixel group 6 are abided together at the vertical 
transfer circuit 2. Likewise, two pixels ic and Id (R and 
G) , toc» are added together at the vertical transfer circuit 
2. Then, the sums of these pixels added together are 
5 further added together at the output amplifier 4. 

In the second mode, the two pixels la and lb along the 
longitudinal column within the color pixel group 6 are added 
together when they are transferred to the horizontal 
transfer circuit 3. Likewise, the two pixels Ic and Id are 

10 added together when they are transferred to the horizontal 

transfer circuit 3, The sums of these pixels added together 
are then further added together at the output amplifier 4. 

In the third mode, the electrical charges at the four 
individual pixels are output only to the vertical transfer 

15 circuit 2 present between the two longitudinal columns along 
which the four pixels la, lb, Ic and Id are provided within 
the color pixel group 6. At this time, the pixels la and ic 
along the lateral row are added together at the vertical 
transfer circuit 2, the pixels lb and Id along the other 

20 lateral row are added together at the vertical transfer 
circuit 2 and then the addition pixels along one 
longitudinal column that are achieved by adding together the 
individual pixels are further added together at the vertical 
transfer circuit 2. 
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Such addition performed on the image - capturing element 
10 may be achieved easily by controlling the drive for the 
electrical charge transfer in the image • capturing element 
10 . 

5 The first addition mode that may be adopted in the 

color pixel group 6 in FIGS. 1 and 2, for instance, is now 
explained. First, an electrode is driven to output the G 
pixel la at the first row / first column to the vertical 

o 

transfer circuit 2 . Next, an electrode is driven to 

M 10 implement vertical transfer of the electric charge at the G 

I fi 

^2 pixel la within the vertical transfer circuit 2. Next, an 

' ^{ electrode is driven to output the B pixel lb to the vertical 

transfer circuit 2 when the electrical charge at the G pixel 
Is, la reaches the position neact to the B pixel lb at the second 

.-; a. 

15 row / first column. This causes the electrical charges at 
the 6 pixel la at the first row / first column and the B 
pixel lb at the second row / first column to be added 
together at the vertical transfer circuit 2 . The R pixel Ic 
at the first row / second column and the G pixel Id at the 

20 second row / second column are added together in a similar 
manner . 

Then, the added electrical charges achieved by adding 
together the pixels in the first column and by adding 
together the pixels in the second column are vertically 
25 transferred to the horizontal transfer circuit 3. At the 



37 



horizontal transfer circuit 3, the added electrical charges 
are transferred horizontally toward the output amplifier 4. 
At the input stage of the output amplifier 4* the electrodes 
are controlled so that the added electrical charge achieved 
5 by adding together the pixels in the first colusm is first 
transferred to the output amplifier 4 and then the added 
electrical charge achieved by adding together the pixels in 
the second column successively floats therein. In this 
manner, at the input stage of the output amplifier 4, the 

10 added electrical charge (la + lb) achieved by adding 
together the pixels in the first colximn and the added 
electrical charge (Ic i- Id) achieved by adding together the 
pixels in the second column are further added together (la + 
lb + Ic + Id) . AS a result, the output amplifier 4 obtains 

15 an output signal 5 achieved by adding together the four 
pixels la, lb, Ic and Id. 

It is to be noted that the other addition modes may be 
achieved by adopting various combinations of the timing with 
which outputs are performed from the individual pixels to 

20 the vertical transfer circuits 2, the timing with which the 
vertical transfer is performed within the vertical transfer 
circuits 2, the timing with which transfer is performed from 
the vertical transfer circuits 2 to the horiiontal transfer 
circuit 3, the timing with which the horizontal transfer is 

25 performed within the horiaontal transfer circuit 3, the 
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timing with which the electrical charges are stored at the 
input stage of the output amplifier 4 and the like. 

Since* when the image - capturing element 10 outputs the 
output signal 5. the four pixels within each color pixel 
5 group 6 are added together so that a virtual addition pixel 
8 corresponding to a brightness signal is directly output as 
the output signal 5 as described above, a black and white 
iip image can be immediately obtained without having to perform 

^ any subsequent arithmetic operation on the R, G and B color 

10 components within the Individual color pixel groups 6. 

ly Namely, since the single image- capturing element 10 can 

I y 

.z, directly output signals corresponding to a color image and a 

black and white image, the subsequent processing load and 
the length of time required for tbe subsequent processing 
i;0 15 can be reduced, and at the same time, since the black and 

i5 white image is constituted by adding together the electrical 

charges, a bigh sensitivity signal output is achieved. 

In addition, the continuous photographing shutter 
intervals for photographing black and white images can be 
20 greatly reduced in an electronic camera employing the image- 
capturing element 10 described above to realize a high speed 
black and white image continuous photographing function. 
For instance, the shutter intervals that are 6 to 7 seconds 
in the prior art can be reduced to 2 seconds. 
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It is to be noted that while the color pixel matrix 
within the image • capturing element 10 explained above adopts 
the Bayer array, the present invention ie not limited to 
this array and any mode may be adopted in regard to the 
5 array of the color components R, G and B pixels within the 
individual color pixel groups 6 . 

Furthermore, while the explanation above is given on 
the premise that the image - capturing element 10 is a CCD 
solid image -capturing element, the present invention is not 
rU 10 limited to this example and it is obvious that the present 

I, n 

invention may be adopted in an amplifier type solid image - 
capturing element that takes out the electrical charges 
stored at the individual pixels 1 through switching 

|:~ processing performed on the pixels 1. 

O 

rfi 15 Next, an electronic camera that functions as an image - 

capturing device employing the image • capturing element 10 
illustrated in FIG. I is explained in reference to FXQS . 4 
and 5 . 

PIG. 4 is a block diagram illustrating the structure of 
2 0 an electronic camera employing the image - capturing element 
10. In FIG. 4, the image -capturing element 10 converts an 
image of a subject 28 input via an optical system 11 to an 
electrical signal. The optical system 11 is provided with 
an infrared blocking filter. 
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A CDS/AGC circuit 12 imparts its CDS effect whereby the 
noise component is reduced through correlated double 
sampling and the li3ce and its AGC effect whereby automatic 
amplification is implemented in correspondeace to the 
5 sensitivity to the output signal from the image - capturing 
element 10, and outputs the resulting signal to an A/D 
converter 13. 

The A/D converter 13 then converts the analog signal 
provided by the CDS/AGC circuit 12 to a 10 -bit digital 
10 signal and outputs the digital signal to a digital signal 
processing unit (DSP) 14. It goes without saying that the 
A/D converter 13 may convert the analog signal provided by 
the CD3/AOC circuit 12 to a digital signal having more than 
10 bits. 

15 The DSP 14 is a signal processing circuit that performs 

processing such as image interpolation processing, black 
level adjustment, gamma correction and knee correction on 
the 10 -bit digital data that have been input, performs 
processing such as matrix processing and contour correction 

20 on the digital data obtained through conversion from the 10- 
bit digital data to 8 -bit digital data, and performs 
processing such as generation of 16 -bit digital data 
comprising an 8 -bit brightness component and an 8 -bit color 
difference component. The DSP 14 is constituted of a one- 

25 chip LSI for digital signal processing. In addition, the 
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DSP 14 also engages in the timing pulse generation 
processing for driving the image - capturing element 10. 

A compress ion/ decompress ion unit 15 perforins 
compresB ion/decompress ion (compression/unpacking) processing 
5 in conformance to the JPEG standard which is the 

international standard for still images, and in more 
specific terms, it is constituted of a one-chip decoder that 
'■'•^^ performs logical processing such as discrete cosine 

== transfer, inverse DCT, Huffman encoding/decoding and the 

If] 10 like. In addition* the compression/decompression unit 15 

I'T-, stores data into a buffer memory 16 and accesses data to the 

buffer memory IS, and also implements a refresh operation 
1^ for the buffer memory 16 constituted of a DRAM. 

i.-E. 

i:3 The buffer memory 16, which is a memory for temporarily 

i'fk 

'5 15 holding the image data corresponding to one frame before the 

image data are compressed at the compression/decompression 
unit 15, and is constituted of a DRAM as described above. 

An SRAH 22 functions as a buffer memory where image 
data that have been compressed at the 
20 compression/decompression unit 15 are temporarily stored 
before they are ultimately stored in a flash memory 26 in 
the form of a JPEG file with header information added. 

The flash memory 26 is a non- volatile memory where the 
image file in the form of a JPEG file with header 
25 information added is ultimately stored. 
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An external interface 27 is an interface for achieving 
data transfer and the like between an external processing 
apparatus such as a personal computer and the electronic 
camera main body. 
5 A digital encoder 17 is constituted of a chip for 

modulating the digital data to an analog video signal. 

A display 18. which may be constituted of an LCD or the 
like, outputs a video signal generated by the digital 
== encoder 17 as display. 

ill 10 An electronic flash device 24 has a function of 

ijl achieving external light modulation control by itself. 

Namely, at the electronic flash device 24, light emission, 
1=^ charge and the like are controlled by a CPU 21 that is to be 

ig detailed later, and the emitted light <zuantity control is 

15 achieved through external light modulation, which is 
realized by the electronic flash device alone. 

An LCD 23 achieves li<^id crystal display of the 
statuses in regard to various photographing modes, the 
nxxraber o£ remaining frames, erasure and battery detection. 
20 The CPU 21, which may be constituted of, for instance, 

a microprocessor, achieves overall control of the individual 
components described above. 

A timing generator 20 generates various pulses for 
driving the image - capturing element 10 and various timing 
25 pul&es used at the individual components described above. 
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Tlie image- capturing element 10 is controlled with drive 
timing pulses supplied by the DSP 14 explained earlier. A 
horizontal transfer pulse for achieving the horizontal 
electrical charge transfer at the image -capturing element 10 
5 directly drives the Image - capturing element 10 via the 

timing generator 20 from the DSP 14. A vertical transfer 
pulse for achieving the vertical electrical charge transfer 
is first input to the timing generator 20 and then the 
image - capturing element 10 is driven by a signal that is 

in 

10 achieved through voltage conversion via a drive unit 19. 

In this structure/ an operating unit 25 includes a 
photographing mode selector switch for switching among 
M various photographing modes and a command dial for setting 

various commands. 

. 15 In other words, the color image photographing mode 

(color mode) and the black and white image photographing 
mode (black and white mode) described earlier are selected 
and specified through the photographing mode selector switch 
at the operating unit 25. When the color mode is specified, 

20 the CPU 21 indicates to the DSP 14 that the color mode has 
been set, and the DSP 14, in turn, generates a drive timing 
pulse for sequentially transferring the pixel groups in the 
horizontal direction in units of single stages in 
conformance to the normal electrical charge transfer control 

25 for the four pixels within each color pixel group 6 to drive 
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the image -capturing element 10 and aleo performs signal 
processing that corresponds to a color image output on the 
output signal that has been input via the A/D converter 13 . 
FIG. 27 is a flowchart illustrating the photographing 
S mode switching control. This control is executed by the CPU 
21. In step SI, the CPU 21 makes a decision In regard to 
the status of the photographing mode selector switch at the 
operating unit 25. The operation proceeds to step S2 if the 
photographing mode selector switch is set to the color mode. 

10 In step S2, the photographing mode is set to the color mode 
and the DSP 14 is notified of the setting. If. on the other 
hand, the photographing mode selector switch is set to the 
black and white mode, the operation proceeds to step S3. In 
step S3i the photographing mode is set to the black and 

15 white mode, and the DSP 14 is notified of the setting. 

In addition, the CPU 21 engages in the control in which 
instructions corresponding to the color mode are issued to 
the other components. If« on the Other hand, the black and 
white mode is specified, the CPU 21 notifies the DSP 14 of 

20 the black and white mode setting, and the DSP 14, in turn, 
generates a drive timing pulse for adding together the four 
pixels within each color pixel group 6 to drive the image - 
capturing element and performs signal processing 
corresponding to a black and white image output on the 

2 5 output signal that has been input via the A/D converter 13 . 
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In addition, the CPU 21 engages in the control in which 
instructions corresponding to the black and white mode are 
issued to the other components. However, in the black and 
white mode^ only the brightneas signal Y needs to be 
5 processed and, as a result, the load corresponding to the 
processing at the DSP 14 and the subsequent processing on 
the signal output by the DSP 14 is smaller compared to that 
in the color mode. 

Furthermore, while the color mode and the black and 

10 white mode are manually switched via the operating unit 2 5 
in this electronic camera, the present invention is not 
limited to this example, and automatic switching control 
whereby the CPU 21 achieves automatic switching based upon 
the light quantity detected by a light quantity detection 

15 unit <not shown) may be implemented^ instead. For instance, 
if a sufficient light quantity cannot be obtained on account 
of the photographing environment being too dark, the 
photographing mode should be switched to the high 
sensitivity black and white mode, whereas when the 

2 0 photographing environment is bright enough, the 

photographing mode should be switched to the high resolution 
color mode. 

It is to be noted that when the color temperature of 
the light source is different from the reference color 
25 temperature in a certain photographing environment, color 
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temperature correction may be achieved by using a color 
correction filter. This hardly affects the processing load 
of the color correction achieved by the DSP 14 in the color 
mode . 

5 FIQ, 5 is a plan view of the electronic camera 

described above. An electronic camera main body 31 is 

i;3 provided with a photographing mode selector switch 32, a 

command dial 33, an tCP 34 and a release switch 35. The 

J J photographing mode selector switch 32, the command dial 3 3 

J;)t 10 and the release switch 35 are part of the operating unit 2 5 

in FTG. 4, whereas the LCD 34 corresponds to the LCD 23 in 
FIG. 4. The photographing mode selector switch 32 is 

1:1 provided to switch between the color mode and the black and 

i, _J 

-^^ White mode, and the mode status selected through this switch 

=3 15 32 is indicated in the LCD 34. in addition, the command 

dial 33 is employed in an operation for setting the shutter 
speed, the aperture value and the like and the results of 
the setting operation performed through the command dial 3 3 
are indicated in the LCD 34. 
20 " Second Embodiment — 

The following is an explanation of the second 
embodiment of the present invention given in reference to 
the drawings- The image -capturing element in the second 
embodiment achieves an improvement in the dynamic range 
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while maintaining a high degree of sensitivity by 
appropriately adding pixels. 

FIG, 6 illustrates the structure of the image - capturing 
element in the second embodiment. An image -capturing 
5 element 110 constitutes a color pixel matrix achieved by 

arraying a plurality of pixels 101, 2m of which are provided 
in the horizontal direction (the direction of rows) and 2n 
of which are provided in the vertical direction (the 
direction of columns) . The color pixel matrix is 

10 constituted of m x n color pixel groups 106 in each of whicln 
all of the 2 x 2 pixels i.e., the four pixels adjacent to 
each other vertically and horizontally, are of a single 
color component . 

When the color pixel matrix is regarded in units of the 

15 m X n individual color pixel groups 106, the color pixel 
matrix adopts an RGB Bayer array. For instance, the four 
pixels, i.e., M(l,l). M(l,2) M(2,l) and M(2,2) In the 2m x 
2n color pixel matrix H are arrayed as a pixel having a 
color filter with the color component Q, the four pixels 

20 i.e., M{1,3> M<1,4) M(2,3) and M(2,4) are arrayed as a pixel 
having a color filter with the color component R, the four 
pixels i.e., M(3«l) M(3,2} H(4,l) and M(4,2) are arrayed as 
a pixel having a color filter with the color component B and 
the four pixels i.e.. M(3,3) M(3,4) M<4.3) and M<4,4) are 
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arrayed as a pixel having a color filter with the color 
component G. 

The pixels 101 each provided with a photoelectric 
conversion element such as a photodlode each function as an 
5 R. Q or B color component pixel, and the individual pixels 
101 having this function are each provided with a color 
filter at the upper surface thereof that allows light having 
the R, O or B color component to be transmitted, as 
explained earlier. As a result, the pixel 101 at the color 

10 pixel matrix H(1>1) for instance, allows transmission of 

only the light with the O (graon) color component, receives 
it and performs photoelectric conversion with it. It is to 
be noted that both m and n are natural numbers. 

In other words, a pixel as referred to in this context 

15 represents a conceptual pixel that includes a photoelectric 
conversion element such as a photodlode, a storage portion 
where the electrical charge generated at the photoelectric 
conversion element is stored and the color filter described 
above , 

20 In this structure, as illustrated in FIG. 7, the 

electrical charges stored at the four individual pixels 
within each color pixel group 106 are added together on the 
image • capturing element 110, and an output signal 105 
adopting a mode whereby individual added electrical charges 

25 achieved through such addition are 6e<iuentially transferred 
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adjacent to each other is output from the image -capturing 
element 110. 

As a result, as illustrated in FIG. &» a pixel array 
adopting an RGB Bayer array achieved in units of the 
5 individual color pixel groups 106 is realized. 

The following addition modes may be adopted in the 
addition operation performed on the image- capturing element 
110 . 

In the first mode, two pixels lOla and IQlb along a 
10 single longitudinal column within the color pixel group 106 
are added together and two pixels 101c and lOld along a 
single longitudinal coliunn within the color pixel group 106 
are added together at vertical transfer circuits 102 , and 
the added pixels are further added together at an output 
15 amplifier 104. 

In the second mode, the tw© pixels 101a and 101b along 
the single longitudinal column and the two pixels 101c and 
lOld along another single longitudinal column within the 
color pixel group 106 are se<iuentially transferred to the 
20 vertical transfer circuits 102, the two pixels along each 
longitudinal column are added together at the horizontal 
transfer circuit 103 when they are transferred to the 
horizontal transfer circuit 103 and the added pixels are 
further added together at the output amplifier 104. 
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In the third mode, the electrical charges at the four 
individual pixels are output only to the vertical transfer 
circuit 102 present between the two longitudinal columns 
(between the pair of pixels 101a and 101b and the pair of 
5 pixels 101c and lOld) Of the four pixels within the color 
pixel group 106, the two pixels lOla and 101c along the 
single horizontal row are added together at the vertical 
transfer circuit 102, the two pixels lOlb and lOld along the 
single horizontal row are added together at the vertical 

10 transfer circuit 102. and the addition pixels along the 

single longitudinal column are then added together at the 
vertical transfer circuit 102. 

In addition, in the fourth mode, the two pixels 101a 
and lOlb along the single longitudinal column within the 

15 color pixel group 106 are added together and the two pixels 
101c and lOld along the single longitudinal column within 
the color pixel group 106 are added together « at the 
vertical transfer circuit 102, then the added pixels are 
directly output as an output signal 105 as they are. 

20 In the fifth mode, the two pixels 101a and 101b along 

the single longitudinal column and the two pixels lOlc and 
lOld along the single longitudinal column within the color 
pixel group 106 are sequentially transferred onto the 
vertical transfer circuit 102, and the two pixels along each 

25 longitudinal column are added together at the horizontal 
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transfer circuit 103 when they are transferred to the 
horizontal transfer circuit 103, then the added pixels are 
directly output as an output signal as they are. 

In the sixth mode, the four pixels within the color 
5 pixel group 106 are seciuentially transferred vertically via 
the vertical transfer circuits 102, then sequentially 
transferred horizontally via the horizontal transfer circuit 
103 and the two pixels 101a and lOlc along the single 
lateral row within the color pixel group 106 are added 
10 together and the two pixels lOlto and lOld along the single 
lateral row within the color pixels group 106 are added 
together at the output amplifier 104, and then the added 
pixels are directly output as an output signal 105 as they 
are . 

15 These addition modes that may be adopted on the image - 

capturing element 110 can be achieved easily by controlling 
the drive of the image - Capturing element 110 during the 
electrical charge transfer. 

With the four pixels in each color pixel group 106 

2 0 added together to be output as the output signal 105 on the 
image- capturing element 110, the electrical charge 
(Quantities corresponding to the R, G and B color components 
within the individual color pixel groups 106 are quadrupled 
relative to the electrical charges of the single pixels, 

25 whereas with the two pixels added together, the electrical 
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charge quantities are doubled. In both caees the 
sensitivity is improved and, at th« same time, the dynamic 
range for the photoelectric conversion can be improved. 
It is to be noted that while 2x2=4 pixels are 
5 provided in each color pixel group 106 in the color pixel 
matrix in the image - capturing element 110 described above, 
the present invention is not limited to this example, and it 
may adopt a structure assuming any array mode with 1x2=2 
pixels, 3 X 3 » 9 pixels, 3 x 2 « 6 pixels or the like. 

10 In addition, while the image- capturing element 110 

above is explained on the premise that it is constittited of 
a CCD solid image -capturing element, the present invention 
is not limited to this example and it is obvious that the 
present invention may be adopted in an amplifier type solid 

15 image - capturing element which takes out electrical charges 
stored at the individual pixels 101 through switching 
processing performed at the pixels 101. 

Since the structure of an electronic camera functioning 
as an image- capturing device employing the image -capturing 

20 element 110 illustrated in FIG. 6 is similar to that of the 
electronic camera illustrated in FIGS. 4 and 5 that has been 
explained in the first embodiment, the following explanation 
is given in reference to FIGS. 4 and 5. The explanation of 
the individual components is omitted. 
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The operating unit 25 includes a photographing mode 
selector switch for switching among various photographing 
modes and a command dial for setting various commands . 

Through the photographing mode selector switch at the 
5 operating unit 25. a high resolution mode for outputting a 
color image in units of the individual pixels 101 in the 
color pixel matrix, a high sensitivity mode for outputting a 
'"■^ color image in units of th« color pixel groups 106, or an 

auto mode for automatically switching between the high 

I Fi 

rp 10 resolution mode and the high sensitivity mode depending upon 

the photographing environment Including the brightness and 
the like is selected and specified. 

When the high resolution mode is specified, the CPU 21 
rn notifies the DSP 14 that the high resolution mode has been 

'% 15 set. The DSP 14, in turn, generates a drive timing pulse 

whei'eby the four pixels within each color pixel group 106 
are transferred in conformance to the regular electrical 
charge transfer control and the pixel groups in the 
horizontal direction are sequentially transferred in units 
20 of individual stages, to drive the image- capturing element 
110. In addition, the signal processing corresponding to 
the color image output is implemented on the output signal 
input via the A/d converter 13 . The CPU 21 also engages in 
the control in which instructions corresponding to the high 
25 resolution mode are issued to the other components. 



when the high sensitivity mode is specified, the CPU 21 
notifies the DSP 14 that the sensitivity mode has been set. 
The DSP 14, in turn, generates a drive timing pulse thereby 
the four pixels within each color pixel group 106 are added 
S together to drive the image - capturing element, and also 

performe the image processing on the output signal input via 
the A/D converter 13. In addition, the CPU 21 engages in 
the control in which instructions corresponding to the high 
sensitivity mode are issued to the other components. 

10 When the auto mode is specified, the CPU 21 notifies 

the DSP 14 that the auto mode has been set. The DSP 14 
generates a drive timing pulse for the image -captuz-ing 
element 110 using, for instance, the high resolution mode as 
the default mode, monitors the brightness component based 

15 upon the output signal from the image - capturing element 110, 
makes a decision as to whether or not the brightness 
component Is e<zual to or less than a specific value and 
switches to the high sensitivity mode if the results of the 
decision -making indicate that the brightness component is 

20 equal to or less than the specific value, whereas it 
sustains the high resolution mode if the brightness 
component is not equal to or less than the specific value. 

FIG. 2d is a flowchart illustrating the photographing 
mode switching control described above. This control is 

25 executed by the CPU 21, In step Sll, the CPU 21 makes a 
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decision in regard to the status of the photographing mode 
selector switch at the operating unit 25. The operation 
proceeds to step S12 if the photographing mode selector 
switch is set to the high resolution mode. In step S12, the 
5 photographing mode is set to the high resolution and the DSP 
14 is notified of the setting. If the photographing mode 
selector switch is set to the high sensitivity mode, on the 
other hand, the operation proceeds to step S13 . In step 
S13, the photographing mode is set to the high sensitivity 

10 mode and the DSP 14 is notified of the setting. if the 

photographing mode selector switch is set to the auto mode, 
the operation proceeds to step S14 in which the 
photographing mode is first set to the high resolution mode 
and the DSP 14 is notified of the setting and then the 

15 brightness signal is monitored from the image- capturing 

element 11. in step S15, a decision is made as to whether 
or not the monitored brightness level is equal to or less 
than the specific value. If it is equal to or less than the 
specific value* the operation proceeds to step S13 in which 

20 the photographing mode is switched to the high sensitivity 
mode. If it is more than the specific value, on the other 
hand, the operation proceeds to step S12 in which the high 
resolution mode is sustained. 

It is to be noted that since* if the output signal is 

25 achieved by adding together only two pixels among the four 
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pixels in each color pixel group 106, the high sensitivity 
and the high resolution, the degrees of which are half way 
between the high sensitivity achieved by adding together the 
four pixels and the high resolution achieved through the 
5 proceesing of the individual pixels* are realized, this may 
be added as an intermediate mode. Furthermore, this 
intermediate mode may be added as an object for switching in 
the auto mode. 

Kow, no. 5 illustrating the first embodiment presents 
10 a pla.n view of the electronic camera. At the electronic 

camera main body 31, the photographing mode selector switch 
32, the command dial 33, the LCP 3 4 and the release switch 
35 are provided. The photographing mode selector switch 32, 
the command dial 33 and the release switch 3 5 are part of 
15 the operating unit 25 illustrated in FIG. 4, with the LCD 34 
corresponding to the LCD 23 in FIG. 4. The photographing 
mode selector switch 32 is provided to select a mode among 
the three modes, i.e., the high resolution mode, the high 
sensitivity mode and the auto mode, and the status of the 
20 mode setting thus selected is indicated on the LCD 34. In 
addition, the command dial 33 is employed in an operation 
for setting the shutter speed, the aperture value and the 
like, and the results of the setting operation and the like 
are indicated on the LCD 34. 



57 



Thus, in the electronic camera, a color image achieving 
a high resolution can be achieved and, at the same time, a 
high sensitivity color image having a wide dynamic range at 
a high degree of sensitivity can be achieved using a single 
5 image -capturing element 110. Furthermore, since the 

switching can be achieved either manually and automatically, 
flexible color image - capturing is realized. 

- Third Embodiment — 

10 The following is an explanation of the third embodiment 

given in reference to the drawings. In the image- capturing 
element in the third embodiment, an image > capture signal 
with a wide dynamic range is achieved through appropriate 
synthesis (or composition) « addition and the like of pixels. 

15 PIG. 9 illustrates the structure of the image -capturing 

element in the third embodiment. An image- capturing element 
210 constitutes a color pixel matrix achieved by arraying a 
plurality of pixels 201, 2m of which are provided in the 
horizontal direction (the direction of rows) and 2n of which 

20 are provided in the vertical direction (the direction of 
columns) . The color pixel matrix is constituted of m x n 
color pixel groups 206 in each of which all of the 2x2 
pixels i.e., the four pixels adjacent to each other 
vertically and horizontally are of a single color component. 



58 



When the color pixel matrix is regarded in units of the 
m X n individual color pixel groups 206. the color pixel 
matrix adopts an RGB Bayer array. For instance, the four 
pixels, i.e., M(l,l), m{1,2), M(2,1) andM{2,2> in the 2m x 
5 2n color pixel matrix M are arrayed as a pixel having a 
color filter with the color component G, the four pixels 
i.e., M(l,3), M(l,4), M(2,3) and M(2,4) are arrayed as a 
^1 pixel having a color filter with the color component R, the 

i.U four pixels i.e.. M{3,1), M(3,2), M{4,1) and M(4,2) are 

J.^ 10 arrayed as a pixel having a color filter with the color 

=^ component B and four pixels i.e., M(3,3). M{3,4), M<4,3) and 

M(4,4) are arrayed as a pixel having a color filter with the 
color component 6. 
J;^ The pixels 201 each provided with a photoelectric 

^3 15 conversion element such as a photodiode each function as an 

R, G or B color component pixel, and the individual pixels 
2 01 having this function are each provided with a color 
filter at the upper surface thereof that allows light having 
the R. O or B color component to be transmitted. As a 
20 result, the pixel 201 at the color pixel matrix M(l,l), for 
instance, allows transmission of only the light with the G 
(green) color component, receives it and performs 
photoelectric conversion with it. It is to be noted that 
both m and n are natural numbers. 
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A pixel as referred to in this context reprefi«ntG a 
conceptual pixel that includes a photoelectric conversion 
element such as a photodiode* a storage portion where the 
electrical charge generated at the photoelectric conversion 
5 element is stored and the color filter described above. 

In addition, as illustrated in FIG. 10, while the 
color filters at the four pixels within each color pixel 
group 206 achieve the same transtnissivi ty (or transtni ttance ) 
for the pixels 201a and 201b provided adjacent to each other 

10 in the vertical direction and the same transmissivi ty for 

the pixels 201c and 201d provided adjacent to each other in 
the vertical direction* the transmissivi ties at the pixels 
201a and 201c adjacent to each other in the horizontal 
direction and at the pixels 2 01b and 20 Id adjacent to each 

15 other in the horizontal direction are different from each 

other. However, the spectral characteristics of the pixels 
adjacent to each other in the horizontal direction are the 
same. Thus, in each color pixel group 206, color filters 
with the same color component but having characteristics 

20 that achieve varying degrees of sensitivity are mounted at 
the pixels adjacent to each other in the horizontal 
direction, whereas color filters with the same color 
component and having characteristics that achieve the same 
degree of sensitivity are mounted at the pixels adjacent to 

25 each other in the vertical direction . 
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In FIG. 10, color filters with the color component G 
and a high degree of sensitivity are mounted at the pixels 
201a and 20lb whereas color filters with the color component 
G and a low degree Of sensitivity are mounted at the pixels 
5 201c and 201d. By adding together the electrical charges at 
the pixels adjacent to each other in the vertical direction 
having the same degree o£ sensitivity, the electrical charge 
quantity can be increased to double the signal quantity. 
The virtual pixel achieved by reading out the electrical 

10 charge quantity achieved by adding together two pixels may 
be regarded as a single pixel located at the center of the 
two pixels. In addition, by separately reading out the 
electrical charge at a pixel with a high degree of 
sensitivity and the electrical charge at a pixel with a low 

15 degree of sensitivity at the same time and synthesizing them 
at a signal processing circuit, the dynamic range can be 
expanded, and this point will be detailed later. The term 
of synthesizing means composing or combining. 

The electrical charges at the two pixels provided 

20 adjacent to each other in each column having the same color 
component among the electrical charges stored at the four 
individual pixels within the color pixel group 206 are added 
together on, for instance, the image capturing element 210, 
and the image- cap turing element 210 outputs an output signal 

25 205 adopting a mode in which the added electrical charges 
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achieved through such addition are sequentially transferred 
adjacent to each other. 

By synthesizing, at an external signal processing 
circuit, an output signal (201a + 201b) and an output signal 
5 (2 01c + 2 Old) having the same color component and adjacent 
to each other in the horizontal direction among the output 
signals achieved by adding together two pixels adjacent to 
each other in the vertical direction, a synthesized signal 
of the pixels with the color component representing the 

10 color pixel group 206, as illustrated in FIG. 10, is 

obtained. A virtual pixel 208 achieved by synthesizing the 
signals corresponding to the four pixels in each color pixel 
group 206 may be regarded as a single pixel located at the 
center of the four pixels. By obtaining output signals 

IS sequentially in this manner for the individual color pixel 
groups 206, an m x n color image having a pixel array 
adopting the RGB Bayer array achieved in units of the 
individual color pixel groups 206 is achieved, as 
illustrated in nO, 11. 

20 The following modes may be adopted for a read out of 

pixel electrical charges or signals. 

In the first mode, the individual pixels are read out 
separately . 

In the second mode, the electrical charges at the 
25 pixeLs 201a and 20lb adjacent to each other along the single 
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longitudinal column and the electrical cliarges at the pixels 
201c and 201d along the single longitudinal column are 
separately added together within the color pixel group 206 
when they are being individually read out to the vertical 
5 transfer circuit 202, and the added electrical charge 

quantities achieved through such addition are read out from 
the vertical transfer circuits 202 sequentially via the 

^3 horizontal transfer circuit 203 and the output amplifier 

y 204. 

jipj 10 In the third mode, the pixels 201a and 201b adjacent to 

'''^ each other along the single longitudinal column and the 

pixels 201c and 201d adjacent to each other along the single 
longitudinal column within the color pixel group 206 are 
sequentially transferred onto the vertical transfer circuits 
•f 15 202 and then the electrical charges are added together at 

the vertical transfer circuit 202. The added electrical 
charges each corresponding to the two pixels adjacent to 
each other in the vertical direction are then sequentially 
transferred to the horizontal transfer circuit 2 03 and are 
20 output via the output amplifier 204. 

Such addition modes as described above can be achieved 
easily by controlling the electrical charge transfer 
operation by the drive circuit at the image - capturing 
element. 
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It is to be noted that the electrical charges at the 
four pixels having the same color component within each 
color pixel group 206 achieving the pixel configuration 
illustrated in FIG, 10 may be added together within the 
5 image - capturing element 210 so that a signal corresponding 
CO the added electrical charge achieved through such 
addition can be obtained as an output signal 205- In this 
case« the ratio of the signal electrical charge quantity 
relative to the noise charge <iuantity can be increased 
10 compared to the ratio achieved at individual pixels so that 
an improvement is achieved both in the sensitivity and the 
dynamic range. 

In order to add together the electrical charges at the 
four pixels within the image - capturing element, the 

15 electrical charges at each pair of two pixels adjacent to 
each other in the vertical direction among the four pixels 
may be added together when they are read out to the vertical 
transfer circuit and the resulting added electrical charges 
adjacent to each other in the horizontal direction may be 

20 then added together at the horizontal transfer circuit for 
output. Alternatively, the electrical charges at each pair 
of two pixels adjacent to each other in the vertical 
direction may be added together at the vertical transfer 
circuit after they are read out to the vertical transfer 

25 circuit, with the added electrical charges adjacent to each 
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other in the horizontal direction further added together 
within the horizontal transfer circuit. 

Next, in reference to FIGS. 12A and 12B, che principle 
of the expansion of the dynamic range which is achieved 
5 through synthesis of pixels adjacent to each other in the 
horizontal direction having color filters with different 
transmissivities , i.e., through synthesis of the pixels 201a 
and 201b and the pixels 201c and 201d, is explained. 

FIO. 12a illustrates the relationship between the light 

10 quantity at a pixel and its photoelectric conversion 

electrical charge quantity before synthesis, and FXG. 12B 
illustrates the relationship after synthesis. In FTG. 12A 
the line LI corresponds to the sum achieved by adding 
together the pixels 201a and 201b and represents the 

15 photoelectric conversion relationship of pixels achieving a 
high degree of sensitivity through the use of color filters 
with a high degree of transmissivi ty . When the light 
quantity exceeds a point PI, the transfer electrical charge 
quantity is saturated. The line L2, which corresponds to 

2 0 the sum achieved by adding together the electrical charges 
at the pixels 201c and 201d illustrates the photoelectric 
conversion relationship of pixels having a low d«gree of 
sensitivity due to the use of color filters with a low 
degree of transmiss ivi ty . While the transfer electrical 

25 charge quantity does not become saturated over the light 
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quantity range illustrated in FIG. 12, the transfer 
electrical charge quantity is low. 

By synthesizing the signals corresponding to th« 
electrical charges at the pixels 201a and 201b with a high 
5 degree of sensitivity and at the pixels 20lc and 201d with a 
low degree of sensitivity using an external signal 
processing circuit, the output that is achieved by linking 
the linear portions of the line LI and the line L2 ,i.e., 
UJ the photoelectric conversion relationship represented by the 

10 line is realized, as shown in FIG. 12B. The external 

s LI 

'= signal processing circuit can synthesize the signals by 

executing a certain software program. Within the range of 
1= the light quantity illustrated in FIG. 12B. the incident 

iri light quantity over a wide range can be converted to a 

'■^ 15 conversion electrical charge quantity without reaching 

saturation to expand the dynamic range. Furthermore, the 
sensitivity, too» can be improved by adding together the 
electrical charges at the pixels adjacent to each other in 
the vertical direction in this case. It is desirable that 
20 the pitches (Inclinations) of the converted electrical 
charge quantities relative to the light quantity at the 
pixels adjacent to each other in the horizontal direction 
achieve a difference of 100% or more. 

Thus, with the signals corresponding to the four pixels 
25 within each color pixel group 206 synthesized as described 
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above, the dynamic range is expanded through the synthesis 
of the signals for the pixels adjacent to each other in the 
horizontal direction whereas the electrical charge quantity 
can be doubled or more through the addition of the 
5 electrical charges at the pixels adjacent to each other in 
the vertical direction to greatly improve the sensitivity. 

In addition, as illustrated in FIG. 13, the four pixels 
within the color pixel group 206 may be arranged in such a 
manner that the pixels adjacent to each other In the 

10 horizontal direction have the same transmissivi ty while the 
transmissivi ties at the pixels adjacent to each other in the 
vertical direction are different from each other. 
Furthermore, while the pixels having the high transmi ssivi ty 
are provided on the upper side with the pixels having the 

15 low transmissivi ty provided on the lower side in FIG. 3, the 
reverse array may be adopted- 

Next, an explanation is given on a structure with the 
four pixels within the color pixel group 206 all having 
different transmissivities . 

20 In FIG. 14, the transmissivities of the individual 

pixels 201a through 201d are set to become lower in the 
order of pixel 201a pixel 201b ~* pixel 201c — ^ pixel 
201d- As a result, by reading out the signals corresponding 
to the four pixels 201a - 201d independently of each other 

25 and linking them together at a signal processing circuit, an 
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extremely wide dynamic range, as illustrated in Fio. 15B, is 
achieved. In FIG. ISA, the pixel 201a having the highest 
sensitivity achieves the photoelectric conversion 
relationship represented by the line LLl that reaches 
5 saturation when the light quantity is equal to or more than 
the point PPl , the pixel 2 01b with the next highest 
sensitivity achieves the photoelectric conversion 
relationship represented by the line LL2 that reaches 
saturation when the light quantity is equal to or more than 

10 the point PP2 , the pixel 2 01c with the next highest 
sensitivity achieves the photoelectric conversion 
relationship represented by the line LL3 that reaches 
saturation when the light quantity is equal to or more than 
the point PP3 and the pixel 201c with the lowest sensitivity 

15 achieves the photoelectric conversion relationship 

represented by the line LL4 that does not reach saturation 
over the range of the light quantity illustrated in FIG. 
15B. Consequently, by synthesizing the signals 
corresponding to the individual pixels 201a through 20ld to 

20 link these polygonal lines, the photoelectric conversion 
characteristics with an extremely wide dynamic range, as 
indicated by the line LL in FIG. 15B, are achieved. 

It is to be noted that when the color pixel groups as 
illustrated in FIGS, 13 and 14 are provided, the electrical 

25 charges at the four pixels within each color pixel group can 
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be added together within the image - capturing element to be 
read out. 

While the image - capturing element 201 described above 
is provided with color pixel groups each having 2x2, i.e., 
5 4 pixels, an image- capturing element 210A with color pixel 
groups each having 1x2, i.e., 2 pixels, is now explained. 
Color pixel groups 2 07 each having 1x2 pixels illustrated 
in FIG. 16 are each constituted by providing together pixels 
having a single color component as in the case of the color 

10 pixel groups 206 each having 2x2 pixels illustrated in 

FIG. 9. These color pixel groups 207 achieve an RGB Bayer 
array in regard to the entire color pixel matrix. in 
addition, pixels 207a and 207b adjacent to each other in the 
vertical direction within each color pixel group 207 are 

15 provided with color filters with different transmissivities , 
as illustrated in FIG. 17. while a color filter achieving a 
high degree of tran&missivi ty is mounted at the pixel 207a, 
a color filter with a low degree of transmissivi ty is 
mounted at the pixel 207b. Thus, a virtual pixel 209 

20 achieved by synthesizing the signals from the pixels 207a 
and 207b at a signal processing circuit achieves a wide 
dynamic range. In addition, while a great improvement in 
the sensitivity cannot be achieved since two of the pixels 
in each group are not added together, as is the case in the 

25 image -capturing element 210 illustrated in FIG. 9, in which 
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every two pixels are added together for an improvement in 
sensitivity, the resolution is improved. Namely, the array 
of the virtual pixels 209 constitutes a 2m x n color matrix, 
as illustrated in FIG. 18. 
5 It is to be noted that while the color pixel groups 206 

in the color image matrix within either the image - capturing 
element 210 or 21OA each have 2 x 2 « 4 pixels or 1 x 2 = 2 
pixels, the present invention is not limited to these 
examples and it may adopt a structure with color pixel 

10 groups having any number of pixels, including 1x2-2 
pixels, 3x3=9 pixels and 3x2*6 pixels in an 
arbitrary array mode. However, it is necessary to provide 
color filters with different transmissi vxties within each 
color pixel group to achieve a wider dynamic range. 

15 In addition, while the image-capturing element 210 is 

explained above on the premise that it is constituted of a 
CCD solid image -capturing element, the present invention is 
not limited to this example and it is obviouB that the 
present invention may be adopted in an amplifier type solid 

20 image-capturing element which takes out the electrical 
charges stored at the individual pixels 201 through 
switching processing performed on the individual pixels 201, 

Since the structure of an electronic camera 
constituting an image - capturing device employing the image - 

25 capturing element 210 illustrated in FIG. 9 or the image- 



70 



capturing element 210A illustrated in FIG. 16 is similar to 
that of the electronic camera illustrated in FIGS. 4 and 5 
that has heen explained in reference to the first 
embodiment, the following explanation is given in reference 
5 to FIGS. 4 and 5. The explanation of the individual 
components is omitted. 

The operating unit 25 includes a photographing mode 
selector switch for switching among various photographing 
modes and a command dial for setting various commands . 

10 Through the photographing mode selector switch at the 

operating unit 25, a high dynamic range mode for setting a 
wide dynamic range, a normal mode for transferring and 
outputting the individual pixels separately from the image - 
capturing element 210 and a high sensitivity mode are 

15 selected and specified. 

When the normal mode is specified, the CPU 21 notifies 
the DSP 14 that the normal mode has been set. The DSP 14, 
in turn, generates a drive timing pulse whereby the pixel 
groups in the horizontal direction are seQuentially 

20 transferred in units of individual stages in conformance to 
the regular electrical charge transfer control implemented 
on the four pixels within each color pixel group 206 to 
drive the image - capturing element 210. In addition, the 
signal processing that supports color image output is 

25 implemented on the output signal input via the A/D converter 



13, The CPU 21 also engages in the control in which 
instructions corresponding to the normal mode to the other 
components . 

When the high dynamic range mode specified, the CPU 21 
5 notifies the DSP 14 that the high dynamic range mode has 
been set. The DSP 14 generates a drive timing pulse for 
adding together every two pixels having the same degree of 
sensitivity within each color pixel group 2 06 and for 
separately reading out signals from the pixels with 

10 different degrees of sensitivity to drive the image- 
capturing element. It also performs synthesizing processing 
on the output signals of the pixels having different degrees 
of sensitivity input via the A/D converter 13. In addition, 
the CPU 21 engages in the control in which instructions 

15 corresponding to the high dynamic range mode are issued to 
the other components. Alternatively, if the pixels are 
arranged as illustrated in FIG. 14, no addition is performed 
within the image- capturing element and the individual pixels 
are independently read out to synthesize the signals from 

20 the Individual pixels. 

In addition, when the high sensitivity mode is 
specified, the DSP 14 generates a drive timing pulse for 
adding together the electrical charges at the four pixels 
within each color pixel group, in the image - capturing 

25 element, to drive the image - capturing element. 
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FIG. 29 is a flowchart illustrating the photographing 
mode switching control described above. This control is 
executed by the CPU 21. In step S21, the CPU 21 makes a 
decision in regard to the status of the photographing mode 
5 selector switch at the operating unit 25. The operation 
proceeds to step S22 if the photographing mode selector 
switch is set to the normal mode. In step S22 . the 
photographing mode is set to the normal mode and the DSP 14 
is notified of the setting. If the photographing mode 

10 selector switch is set to the high dynamic range mode, on 

the other hand, the operation proceeds to step S23. in step 
S23, the photographing mode is set to the high dynamic range 
mode and the DSP 14 is notified of the setting. The DSP 14 
receives signals from the pixels with different degrees of 

15 sensitivity via the A/D converter 13 and the like, and then 
performs the synthesis ing processing with a certain program. 

It is to be noted that although the third embodiment 
shows an example that the DSP 14 performs the synthesizing 
processing as described above, the external signal 

20 processing circuit to perform the synthesizing processing is 
not limited to the DSP 14. For example, the CPU 21 may 
receive signals from the pixels with different degrees of 
sensitivity via the A/D converter 13 and the like, and may 
perform the synthesizing processing with a certain program. 
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In other words, any circuit that can perform the 
synthesizing processing can be adopted. 

FIO. 5 is a plan view of the electronic camera. At the 
electronic camera main body 31, the photographing mode 
5 selector switch 32, the command dial 33, the LCD 34 and the 
release switch 35 are provided. The photographing mode 
selector switch 32, the command dial 33 and the release 
switch 35 are part of the operating unit 25 illustrated in 
FIG. 11, with the LCD 34 corresponding to the LCD 23 in FIG. 

10 11. The photographing mode selector switch 32 is provided 
to select a mode among the individual modes and the mode 
setting thus selected is indicated on the LCD 34. In 
addition, the command dial 3 3 is employed in an operation 
for setting the shutter speed, the aperture value and the 

15 like, and the results of the setting operation and the like 
are indicated on the LCD 34. 

Thus, in the electronic camera illustrated in FIG.. 11, 
a color image is achieved both in the normal mode and the 
high sensitivity mode and In addition, a color image with a 

20 wide dynamic range is achieved with the same image - capturing 
element 210. 

In other words, in the electronic camera in this 
embodiment, in which a plurality of color filters of the 
same color with different degrees of tranamissivi ty are 
25 mounted, the dynamic range can be greatly expanded by 



independently reading out the signals from the pixels 
mounted with color filters having different degrees of 
transmissivity and connecting them together through signal 
processing to achieve a color imago with an extremely wide 
5 dynamic range. In addition, by adding together the 

electrical charges at a plurality of pixels having the same 
color within the image - capturing element, the signal 
electrical charge quantity can be increased relative to the 
noise electrical charge ^antity to increase both the 

10 sensitivity and the dynamic range. Furthermore, by 

combining the addition of the electrical charges performed 
within the image- capturing element and the synthesis through 
the signal processing^ image -capturing over an extremely 
wide dynamic range can be achieved at a high degree of 

15 sensitivity. 

It is to be noted that in the third embodiment the 
synthesizing processing is performed in the signal 
processing circuit outside of the image - capturing element, 
since the conversion electrical charge quantity is saturated 

2 0 beyond a certain electrical charge quantity as shown in the 
signal Ll of fig. 12A for example. However, if the vertical 
transfer circuit 202, the horizontal transfer circuit and/or 
the output amplifier 204 is designed not to saturate with 
regard to electrical charge when adding electrical charges 

25 of pixels, the synthesizing processing can be performed by 
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adding electrical charges of pixels in the image - capturing 
element to obtain the signal L of PIG. 12B- 

— Fourth Embodiment — 
5 The following is an explanation of the fourth 

embodiment given in reference to the drawings. 

FIG. 19 illustrates the structure of the CDS circuit in 
the fourth embodiment constituting the image - capturing 
circuit according to the present invention. The CDS circuit 

10 illustrated in PIG. 19 is constituted basically by providing 
a plurality of sample hold circuits 110 one of which Is 
provided in the CDS circuit in FIG. 25. In the CDS circuit 
in FIG. 19, the electrical charge that has undergone 
photoelectric conversion and has been transferred at an 

15 image -capturing element 301 is output to a clamp circuit 306 
via a buffer amplifier 302 as an image capture signal. 

The clamp circuit 306 outputs the output from the 
buffer amplifier 302 via a coupling capacitor 303, and also, 
applies a voltage provided by a DC voltage source 3 05 to the 

20 output side of the coupling capacitor 303 through operation 
of a switch 304 with the timing of a timing pulse ap . Thus, 
the image -capture signal from the coupling capacitor 3 03 is 
clamped at the field- through level LS to remove the reset 
noise, the output amplifier noise and the like generated at 

25 the image-capturing element 301. 
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The image - capture signal output from the clamp circuit 

306 is then output, at least, to a sample hold circuit 310 
via a buffer amplifier 307, In addition, through a switch 
315. the image -capture signal output by th« clamp circuit 

5 306 is also output to a sample hold circuit 314 via the 

buffer amplifier 307 when th« switch 315 is in an ON state. 
In other words, when the switch 315 is set to ON. a parallel 
input of th* image-capture signal to the sample hold 
circuits 310 and 314 is enabled. wh«reae when the switch 315 

10 is in an OFF state* the image-capture signal is input only 
to the sample hold circuit 310. 

The sample hold circuit 310 samples the image - capture 
signal provided by the buffer amplifier 307 using a clamp 
pulse 03l input to a switch 308, and outputs the level of 

15 the signal held at a holding capacitor 3 09 as an image - 
capture signal. Next, the image-capture signal at the 
signal level LI output by the sample hold circuit 310 is 
output via a buffer amplifier 311, is subsequently converted 
to a digital signal at an A/D converter (not shown) and 

20 desired image data that have undergone various types of 
signal processing are output. 

The sample hold circuit 314. on the other hand, samples 
the image-capture signal provided by the buffer amplifier 

307 using a clamp pulse as2 input to a switch 312, and 

25 outputs the level of the signal held at a holding capacitor 
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313 as an image - capture signal. Next, the image • capture 
signal at the signal level L2 output by the sample hold 
circuit 314, too, is output via a buffer amplifier 311 as is 
the image -capture signal at the signal level 1*1, and is 
5 subseQuently converted to a digital signal at an A/D 

converter (not shown) , and desired image data that have 
undergone various types of signal processing are output. 
Next, the operation performed by the CDS circuit 

U illustrated in FIQ. 19 is explained in reference to the 

Q 10 timing chart in FIGS. 20A through 20D. 

~ As shown in FIG. 20A« the image-capture signal output 

by the image - capturing element 301 via the buffer amplifier 
^ 3 02 is seQuentially transferred and output as an image - 

□ capture signal having a signal level Ll achieved through a 

~ 15 conversion at the individual photoelectric conversion 

elements at the image - capturing element 301 and having an 
added signal level L2 achieved by adding the signal level of 
the electrical charge at the pixel, which is transferred 
next to the signal level LI, to the signal level LI. 
2 0 Namely « the image - capturing element output is achieved by 
combining image - capture signals that include the signal 
level LI achieved without any addition and the added signal 
level L2 achieved through addition, and a reset R is 
implemented every this combination. 
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The clamp pulse shown in FIG. 206 is applied during 
the period of time elapsing between a time point tl a.nd a 
time point t2 following a reset R, and the image - capturing 
element output is clamped at the field- through level LS that 
5 has been applied to be adjusted to the reference level, 
which does not contain any noise, 

Next, the timing pulse aal shown in FIG. 20C is 
supplied to the sample hold circuit 310 during the period of 
time elapsing between a time point t3 and a time point t4, 
10 and the signal level LI after clamping is sampled using this 
timing pulse 0sl and is held. The signal level LI thus held 
is output as an image- capture signal. In other words, the 
signal level LI referring to the field- through level LS is 
output. 

15 Then, the timing pulse 032 shown in FIG. 2 0D is 

supplied to the sample hold circuit 314 during the period of 
time elapsing between a time point t5 and a time point z6 , 
and the added signal level L2 after clamping is sampled 
using this timing pulse 0s2 and is held. The added signal 

2 0 level L2 thus held is output as an image - capture signal. In 
other words, the added signal level L2 referring to the 
field- through level LS is output. 

In this case, since another reset R and processing for 
clamping the signal at the field- through level LS are not 
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implemented for taking out the added signal level L2 . the 
reset R and the clamp processing are utilized effectively. 

In addition, when the switch 315 Ib in an ON state, the 
signal level LI and the added signal level L2 are sampled 
5 using the sampling pulses esl and 0s2 that are secjuentially 
supplied to the sample hold circuits 310 and 314 
respectively, and these single levels are sequentially 
output via the buffer amplifier 311. If. on the other hand, 
the switch is in an OFF state, only the signal level LI is 

10 output via the buffer amplifier 311. 

It is to be noted that when the added electrical 
charges are to be further output from an FDA continuously, a 
plurality of sample hold circuits, the number of which 
correspond to the number of continuous addition operations, 

15 should be provided so that the sampling pulses for sampling 
the individual signal levels achieved through addition are 
supplied to the individual sample hold circuits for sample 
holding. In addition, the switch 315 should be employed as 
a selector switch for switching the connection states of the 

20 plurality of sample hold circuits. 

Now, an image -capturing element 3 01, in which the 
electrical charges at the individual pixels are output while 
they are being added together by an FDA is explained. 
FIO. 21 illustrates the structure of the image- 

25 capturing element 301. In FIQ. 21, the image - capturing 
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element 301 constitutes a color pixel matrix achieved by- 
arraying a plurality of pixels 331, 2m of which are provided 
in the horizontal direction (the direction of rows) and 2n 
of which are provided in the vertical direction (the 
5 direction of columns) . The color pixel matrix is 

constituted of m x n color pixel groups 336 in each of which 
all of the 2x2 pixels = 4 pixels adjacent to each other 
vertically and horiaontally are of a single color component. 
When the color pixel matrix is regarded in units of the 

10 m X n individual color pixel groups 336, the color pixel 
matrix adopts an RGB Bayer array. For instance, the four 
pixels, i.e., M(l,l), M(l,2) M(2,l) and M(2,2) in the 2 m x 
2 n color pixel matrix M all have a color filter with the 
color component G, the four pixels i.e., M(l,3) M(l,4) 

15 M(2,3) and M(2,4) all have a color filter with the color 

component R, the four pixels i.e., M(3,l) M(3,2) M(4,l) and 
M(4,2) all have a color filter with the color component B 
and the four pixel* i.e., M(3,3) M(3,4) M<4,3) and M(4,4) 
all have a color filter with the color component G in this 

20 array. 

The pixels 331 each constituted with a photoelectric 
conversion element such as a photodiode each function as an 

G or B color component pixel, and the individual pixels 
331 having this function are each provided with a color 
25 filter at. the upper surface thereof that allows light having 
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the R, G or B color component to be transmitted. Ae a 
result, the pixel 331 at the color pixel matrix M(l,l) for 
instance, allows transmission of only the light with the G 
(green) color component, receives it and performs 
5 photoelectric conversion on it. It is to be noted that both 
m and n are natural numbers . 

The electrical charges stored at the four individual 
pixels within each color pixel group 33 6 are added together 
on the image- capturing element 301, and an output signal 5 
10 adopting a mode whereby added electrical charges achieved 

through such addition are sequentially transferred adjacent 
to each other is output from the imago - capturing element 
301. 

Namely, the individual pixels 331 are output onto 
15 vertical transfer circuits 332 in synchronization with each 
other, the pixels adjacent to each other in the vertical 
direction within the color pixel group 336 are then added 
together at the vertical transfer circuits 332 and the 
results of the addition are output to the horizontal 
20 transfer circuit 333. The horizontal transfer circuit 333 
then transfer the addition pixels, which have been 
transferred from the vertical transfer circuit 332 
seouentially in units of individual stages, to a floating 
diffusion amplifier (PDA) 334. 
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The FDA 334 further adds together the addition pixels 
adjacent to each other in the horizontal direction in each 
color pixel group 3 36 to generate an addition pixel 338 
achieved by adding together the electrical charges at all 
5 the pixels within the color pixel group 336. It iB to be 
noted that while, when adding the signal level of the next 
pixel to the signal level of the first pixel during the 
process for generating an addition pixel, the signal level 
of the first pixel is held and the signal level of the 

10 following pixel is added to the signal level that has been 
held, the signal level of the first pixel is also output to 
the CDS circuit as in the image -capture signal output 
illustrated in riG. 20A as a portion of the output signal SI 
concurrently as the signal level is held. As a result, the 

15 signal level Ll In FIG. 20A represents the added electrical 
charge level achieved by adding together the electrical 
charges at the pixels adjacent to each other in the vertical 
direction within the color pixel group 336 and the added 
signal level L2 represents the added electrical charge level 

20 achieved by adding together the electrical charges at all 
the pixels within the color pixel group 336. 

It is to be noted that such addition to be performed on 
the image -capturing element 301 can be easily achieved by 
controlling the drive of the image- capturing element 301 in 

25 its electrical charge transfer operation. 
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Next, variation X of the CDS circuit is explained. As 
illustrated in FIG. 23. variation 1 assumes a structure 
achieved by eliminating the switch 315 from the CDS circuit 
illustrated in PIO. 19. which allows the individual sample 
5 hold circuits 310 and 314 to achieve a parallel output via 
buffer amplifiers 311 and 316 respectively, independently Of 
each other. 

As a result, the signal level LI achieved without 
addition and the signal level L2 achieved through addition 

10 are respectively output through the buffer amplifiers 311 
and 316 at all times with the generation of the sampling 
pulses 0sl and 0s2 . 

Now, variation 2 of the CDS circuit is explained. 
Variation 2 assumes a structure achieved by adding a 

15 subtracter 317 to the CDS circuit illustrated in FIG. 23. as 
illustrated in FIG, 24. In FIG- 24, a signal level L3 
achieved by subtracting the signal level LI output via the 
buffer amplifier 311 from the added signal level L2 output 
via the buffer amplifier 316/ i.e., a signal level L3 which 

20 is transferred next to the signal level LI achieved without 
addition, can be obtained. In addition, the signal level LI 
output via the buffer amplifier 311 is output unchanged. 
Consequently, the signal level LI and the signal level L3 
can be output in parallel. 
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Thus, with A representing the level value of the signal 
level LI and B representing the level value of the signal 
level L3 , A and A+B can be alternately output in series in 
the embodiment, A and A+B can be output in parallel in 
5 variation 1 and A and B can be output in parallel in 
variation 2. 

It is to be noted that while the individual color pixel 
groups 336 in the color pixel matrix within the Image- 
capturing element 301 each have 2 x 2 » 4 pixels, the 
10 present invention is not limited to this example and a 

structure adopting any array mode with an arbitrary number 
of pixels in each color pixel group, such as 1x2-2 
pixels, 3x3=9 pixels and 3x2=6 pixels, may be 
assumed. 

15 In addition, while the image- capturing element 301 is 

explained above on the premise that it is constituted of a 
CCD solid image- capturing element, the present invention is 
not limited to this example and it is obvious that it may be 
adopted in an amplifier type solid image - capturing element 

20 that takes out electrical charges stored within the 

individual pixels 331 through switching processing performed 
on the Individual pixels 331. 

Since the structure of an electronic camera 
constituting an image- capturing device employing one of the 

25 CDS circuits described above is identical to the structure 
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of the electronic camera in the first embodiment illustrated 
in FIGS. 4 and 5 except for the CDS circuit, the following 
explanation is given in reference to FIGS. 4 and 5. The 
explanation of the individual components is omitted. 
5 The operating unit 25 includes a photographing mode 

selector switch for switching among various photographing 
roodee and a command dial for setting various commands . 

Through the photographing mode selector switch at the 
operating unit 25, a high resolution mode for outputting a 

10 color image in units of the individual pixels 331 in the 

color pixel matrix, a high sensitivity mode for outputting a 
color image in units of the color pixel groups 336 or an 
auto mode for automatically switching between the high 
resolution mode and the high sensitivity mode depending upon 

15 the photographing environment Including the brightness and 
the like is selected and specified. 

When the high resolution mode is specified, the CPU 21 
notifies the DSP 14 that the high resolution mode has been 
set. The DSP 14. in turn, generates a drive timing pulse 

20 for transferring electric charges^ adding together the two 
pixels adjacent to each other in the vertical direction in 
each color pixel group 33 6, and outputting the signal, to 
drive the image - capturing element 301. In addition, the 
signal processing that supports color image output is 

25 implemented on the output signal via the A/D converter 13. 
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At this time, the CDS circuit within the CDS/AGC circuit 12 
only outputs the signal level hi sampled and held by the 
sample hold circuit 310. In addition, the CPU 21 engages in 
the control in which instructions corresponding to the high 
5 resolution mod« are issued to the other components. 

When the high sensitivity mode is specified, the CPO 21 
notifies the DSP 14 that the high sensitivity mode has been 
J set. The DSP 14, in turn, generates a drive timing pulse 

y Whereby the four pixels within each color pixel group 33 6 

^ 10 are added together to drive the image -capturing element, and 

also performs image processing on the output signal via the 
A/D converter 13. At this time, the CDS circuit within the 
X CDS/AGC circuit 12 only outputs the added signal level 1,2 

% sampled and held by the sample hold circuit 314. Xn 

^ IS addition, the CPU 21 engages in the control in which 

instructions corresponding to the high sensitivity mode are 
issued to the other components. 

If the auto mode is specified, the CPU 21 notifies 
the DSP 14 that the auto mode has been set. The DSP 14 
20 generates a drive timing pulse for the image -capturing 

element 301 using, for instance, the high resolution mode as 
the default mode, monitors the brightness component based 
upon the output signal from the image - capturing element 3 01, 
makes a decision as to whether or not the brightness 
25 component Is equal to or less than a specific value and 
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switches to the high sensitivity mode if the results of the 
decision -making indicate that the brightness component is 
equal to or less than the specific value, whereas it 
sustains the high resolution mode if the brightness 
5 component is not e<iual to or less than the specific value. 

FIG. 5 presents a plan view of the electronic camera. 
At the electronic camera main body 31, the photographing 
mode selector switch 32, the command dial 33 « the LCD 34 and 
the release switch 35 are provided. The photographing mode 

10 selector switch 32, the command dial 33 and the release 

switch 35 are part of the operating unit 25 illustrated in 
FJG. 4, with the LCD 34 corresponding to the LCD 2 3 in FIG. 
4. The photographing mode selector switch 32 is provided to 
select a mode among the three modes, i.e., the high 

15 resolution mode« the high sensitivity mode and the auto 

mode, and the mode setting thus selected is indicated on the 
LCD 34. In addition, the command dial 33 is employed in an 
operation for setting the shutter speed, the aperture value 
and the like, and t;he results of the settings operation and 

20 the like are indicated on the LCD 34. 

Thus, through the electronic camera, a desired color 
image is achieved by selecting the high resolution mode, the 
high sensitivity mode or the autO mode for automatically 
switching between the high resolution and the high 

2 5 sensitivity mode in correspondence to the photographing 
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environment using the results of the output from the CDS 
circuit achieving a high degree of efficiency provided 
inside the CDS/AOC circuit 12. 

In other words, since the CDS circuit according to the 
5 present invention is provided with a plurality of sample 

hold circuits, the signa.1 levels corresponding to the signal 
electrical charges achieved without addition and the signal 
electrical charges achieved through addition can be 
extracted continuously through a simple structure, and these 
10 signal levels can be output in an arbitrary manner. As a 
result, an image achieving a high degree of sensitivity or 
an image with a high degree of resolution can be output. 

- Fifth Embodiment - 

15 The following is an explanation of the fifth 

embodiment, given in reference to the attached drawings. 

FIG. 30 illustrates the structure of the image- 
capturing element employed in the fifth embodiment. The 
image -capturing element 510 constitutes a color pixel matrix 

20 achieved by arraying a plurality of pixels 501, i.e., 2m 

pixels 501 along the horizontal direction (the direction of 
rows) and 2n pixels 501 along the vertical direction {the 
direction of columns) . The color pixel matrix comprises m x 
n color pixel groups 506 each constituted of 2 x 2 = 4 
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pixels of a single color adjacent to each other in the 
vertical and horizontal directions. 

The m X n color pixel groups 506 in the color pixel 
matrix are arranged in an RCB Bayer array. Por instance, 4 
5 pixels M(l, 1), M (1, 2), M(2, 1) and M(2, 2) in the 2m x 2n 
color pixel matrix each have a color filter with the color 
component G in the array, 4 pixels M(l, 3), M <1, 4), M(2, 
3) and M(2, 4) each have a color filter with the color 
component R in the array, 4 pixels M(3, 1). M (3, 2), M(4, 

10 1) and M<4, 2) each have a color filter with the color 

component B in the array and 4 pixels M(3, 3), M (3, 4), 
M(4, 3) and M(4, 4) each have a color filter with the color 
component G in the array. In the explanation, a pixel M{i, 
j) indicates a pixel at row i, column j. 

15 These pixels 501, each constituted of a photoelectric 

conversion element such as a photodiode, function as a pixel 
with the R, G or B color component. This function is 
achieved by providing the color filter described above that 
allows light with the R, G or B color component to be 

20 transmitted on the upper surface of each pixel 501. Thus, 
the pixel SOI i.e,, the pixel M(l, I) in the color pixel 
matrix, for instance, allows only light with the G (green) 
color component to be transmitted to the element for 
photoelectric conversion. It is to be noted that the m and 

25 n each represent a natural number. 
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As illustrated in FIG. 31, the electrical charges 
stored at the 4 pixels in each color pixel group 506 are 
added together at the image - capturing element 510, and 
electrical charges each resulting from the addition of a 
5 given color pixel group are sequentially transferred and 
output to achieve an output signal 505. 

As a result, as illustrated in FIG. 22, the pixels are 
arranged in an RGB Bayer array achieved in units of the 
individual color pixel groups 5 06. The Bayer array in this 

10 example is achieved by arraying the color component G in 

accordance with the brightness signal in a checkered pattern 
with the color component R and the color component B arrayed 
in a checkered pattern in the remaining area, as Illustrated 
in FIG. 32. The color component R and the color component B 

15 are arrayed on alternate lines along the horizontal 

direction <the direction of rows) or the vertical direction 
(the direction of columns) . It is to be noted that the 
conceptual details of the Bayer array are of the known art. 

The modes of addition that may be adopted by the image - 

20 capturing element 510 include the following. 

In the first mode, the electrical charges at two 
pixels, e.g.. pixels 501a and 501b or pixels 501c and SOld, 
along a single column in the longitudinal direction in each 
color pixel group 506 are added together on a vertical 

25 transfer circuit 502, and the individual pixels resulting 
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from such addition are added together on an output eunplifier 
504 constituted of an FDA (floating diffusion amplifier) , 

In the second mode, the electrical charges are 
sequentially transferred onto a vertical transfer circuit 
5 502 in units of two pixels 501a and 501b or 501c and 501d 

provided along a single column in the longitudinal direction 
in each color pixel group 506, the electrical charges at 
each two pixels along a single column in the longitudinal 
direction are added together on a horizontal transfer 
10 circuit 503 when they are transferred to the horizontal 
transfer circuit 503 and pixels each resulting from such 
addition are then added together at the output amplifier 
504 . 

In the third mode, the electrical charges at the 
15 individual four pixels are output only to the vertical 

transfer circuit 502 present between the two columns along 
the longitudinal direction (between the pixels SOla, 501b 
and the pixels 501c , 501d} among the four pixels in a given 
color pixel group 506, the electrical charges at the two 
2 0 pixels sola and SOlc along the lateral row are added 

together on the vertical transfer circuit 502 and then 
pixels each resulting from such addition of the electrical 
charges at pixels laterally along the row are added together 
longitudinally at the vertical transfer circuits 502. 
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Such addition performed on the image -capturing element 
510 can be implemented easily by controlling the drive of 
the electrical charge transfer to the image- capturing 
element 510. 

5 When adding together the electrical charges at the four 

pixels in each color pixel group 506 during the process in 
which an output signal 505 is output at the image - cap turing 
element 510 in this manner, the quantity of the electrical 
charge corresponding to the R, G or B color component in 

10 each color pixel group 506 is four times the electrical 
charge <iuantity of a single pixel, which leads to an 
improvement in sensitivity. 

Next, let us focuB on four pixels M (2, 2), M (2, 3), M 
(3, 2) and M(3, 3) in the color pixel matrix at the image - 

15 capturing element 510 in PIG. 33, The color pixel group 507 
comprising these four pixels achieves an RGB Bayer array 
(Gx2, Rxl, Bxl) , and the color pixel groups adjacent to it 
each achieve a pixel array of the same combination, too. 
Thus, by adding together the electrical charges of the four 

20 pixels 507a - 507d in each color pixel group 507, as 

illustrated in FIG. 34, while excluding the pixels in the 
uppermost row, the lowermost row, the left end column and 
the right end column in the 2m x 2n color pixel matrix, 
addition pixels 509 each corresponding to a brightness 
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signal Y can be directly obtained from the image - cap turing 
element 510- 

In this case, the control of the drive of electrical 
charge transfer to the image -capturing element 501 can be 
5 implemented by shifting both the vertical transfer pulse and 
the horizontal transfer pulse by one pixel. In addition, it 
is obvious that the addition processing for the individual 
color pixel groups 507 can be realized easily by adopting 
the addition processing performed for the color pixel groups 
10 506. 

However, as illustrated in FIG. 35, the addition pixels 
509 thus obtained achieve an (m - 1) x (n. - 1) pixel matrix 
and, consequently, the vertical transfer pulse and the 
horizontal transfer pulse must be supplied by taking into 
15 consideration this point. 

As a result, a black and white (monochrome, monotone) 
image generated by using the addition pixels 509 alone 
achieves higher resolution compared to a black and white 
image generated based upon addition pixels 506, and 
20 furthermore, the brightness signals can be directly obtained 
from the image - capturing element 510. 

It is to be noted that while the brightness signals 
must satisfy a relationship of 

Y ^ 0.299R t- 0.587G ♦ 0.144B, in principle, a relationship 
2 5 expressed as 
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Y = R + 2G + B may be adopted in approximation. 

Since the structure of an electronic camera 

constituting an image - capturing device that employs the 

image -capturing element 510 illustrated in FIG. 30 or FIG. 
5 3 3 is similar to the structure shown in FIGS. 4 and 5 

illustrating the first embodiment, the following explanation 

is given in reference to FIGS. 4 and 5. An explanation of 

the individual components is omitted. 
Id An operating unit 2 5 includes photographing mode 

iQ 10 selector switches operated to switch to various 

photographing modes and a command dial operated to set 

various commands. 

M Namely, by operating the operating mode selector 

ig switches at the operating unit 25, an instruction is issued 

15 to switch to either the color image mode or the high 
resolution black and white image mode. 

In conformance to such an instruction to switch to the 
color image mode or the black and white image mode, the 
control of the drive of the image -capturing element 510 in 
2 0 the color image mode or the control of the drive of the 
image - capturing element 510 in the black and white image 
mode is implemented as described earlier. 

When the color image mode is selected, a CPU 21 
indicates to a DSP 14 that the color image mode has been 
25 set, and the DSP 14, in response, generates a drive timing 
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pulse for adding together the electrical charges at the four 
pixels in each color pixel group 506 to drive the iraage- 
capturiag element 510 via a timing generator 20. In 
addition, signal processing which corresponds to the color 
5 image output is performed on an image-capturing signal input 
via an A/D converter 13 . The CPU 21 also implements control 
of the other components by issuing relevant instructions 
corresponding to the color image mode. 

When the black and white image mode is selected, the 

10 CPU 21 indicates to the DSP 14 that the black and white 
image mode has been set, and in response, the DSP 14 
generates a drive timing pulse for adding together the 
electrical charges at the four pixels in each color pixel 
group 507 to drive the image - capturing element 510 via the 

15 timing generator 20. In addition, signal processing is 

performed on the image -capturing signal input via the A/D 
converter 13, The CPU 21 also implements control of the 
other components by issuing relevant instructions 
corresponding to the black and white image mode. 

20 Next, in reference to FIG. 36, a detailed explanation 

is given on the functional structure of the DSP 14. In FIG. 
36, the DSP 14 is provided with two selector switches 531 
and 539- When the color image mode is selected, the switch 
531 is connected to a terminal 531a and the switch 539 is 

25 connected to a terminal 539a. When the black and white 
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image mode is selected, on the other hand, the switch 531 is 
connected to a terminal 531b and the switch 539 is connected 
to a terminal 539b. 

When the color image mode is selected, an image - 
5 capturing signal corresponding to an addition pixel 508 
representing each color pixel group 506 is input from the 
13 A/D converter 13 as explained earlier, and this image - 

= capturing signal is input to an interpolation processing 

unit 533 via the terminal 531a of the switch 531, where the 
IQ 10 image- capturing signal undergoes a specific type of 

interpolation processing* The color component signals G, R 
and B having undergone the interpolation processing then 
'''^2 undergo matrix conversion to generate Y, Cb and Cr, which is 

W output to a compression/decompression unit 15 through an 

• =1 IS output line L via low pass filters 535. During this 

process, the color component signal G output from the 
interpolation processing unit 533 extracts outlines in the 
image via a band pass filter 536, and a signal achieved by 
amplifying the extracted signal at an amplifier 537 is then 
20 added to the brightness signal Y via an adder 538. Thus, 

the brightness signal Y becomes a signal with the emphasized 
outlines in the image. 

It is obvious that when the image is ultimately output 
with the RGB colorimetric system, the color component 
25 signals O. R and B may be directly output to the 
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compression/decompression unit 15 from the output line L via 
the low pasB filters 535. without providing the YCbCr 
conversion unit 534. 

When the black and white image mode is selected, on the 
5 other hand, an image - capturing signal constituting the 
brightness signal corresponding to an addition pixel 509 
representing each color pixel group 507 is input from the 
A/D converter 13 as explained earlier, and this image- 
capturing signal is output to the terminal 539b of the 

10 switch 539 via the terminal 531b of the switch 531 and a low 
pass filter 532. The terminal 539b is connected to the 
output line through which the brightness signal Y is output 
when the color image mode is selected. Thus. th« image - 
capturing signal is output directly to the 

15 compression/decompression unit 15 as the brightness signal 
Y. 

As explained above, in the electronic camera in the 
fifth embodiment, a single image - capturing element 510 is 
employed and a signal processing circuit or software to 

20 perform interpolation processing to generate black and white 
pixel signals from color pixel signals is not required. And 
color images and high resolution black and white images can 
be selectively output from the image- capturing element 510 
directly simply by switching the drive control of the image- 

25 capturing element 510, thereby achieving an efficient image- 
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capturing device. In addition, occurrence of jaggies that 
may otherwise manifest when signal processing is performed 
to produce a black and white image from color component 
pixels can be prevented. 
5 It is to be noted that while the color pixel groups 506 

at the image- capturing element 510 explained above each 
comprise 2 X 2 ■ 4 pixels, the present invention is not 

=._i 

limited to this example and color pixel groups at the image- 
ill capturing element may each comprise any other number of 

J;J1 10 pixels achieved by <even number) X (even number) . For 

instance, the color pixel groups may each comprise 4X6- 
M 24 pixels. The number must be (even nximber) X (even number) 

=: to facilitate partitioning of the color pixel groups 506 to 

'-'d achieve the color pixel groups 507 required for obtaining a 

2 15 black and white image. For instance, color pixel groups 

each having 4 X 6 = 24 pixels can each be partitioned into 
pixel groups having 2X3-6 pixels in the horizontal and 
vertical directions respectively, and using those 
partitioned groups, new 4X6 color pixel groups that 
20 correspond to the color pixel groups 507 may be constituted. 
In addition, in this case, the vertical transfer pulse 
should be shifted by 3 pixels and the horizontal transfer 
pulse should be shifted by 2 pixels. FIG. 37 presents an 
example of color pixel groups each having 4 X 6 ° 24 pixels 
25 as described above. The color pixel groups 506 are each 
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constituted of 4 X 6 = 24 pixels of a single color. The 
color pixel groups 507 are realized through a Bayer array 
achieved in units pixel groups each having 2X3-6 pixels 
representing a single color. 
5 It is to be noted that while the explanation has been 

given above on the premise that the image -capturing element 
510 is constituted of a CCD solid image -capturing element, 
the present invention is not limited to this example, and it 
is obvious that it may be adopted in an amplifier - type solid 

10 image- capturing element that sweeps out the electrical 
charges stored in the individual pixels 501 through 
switching processing performed on the individual pixels 501. 

While the explanation has been given above on the first 
through fifth embodiments by using an example in which the 

15 present invention is adopted in an electronic camera, it is 
not limited to the particulars of the example. The image - 
capturing elements in the individual embodiments may be 
adopted in an electronic video camera. In other words, the 
present invention may be adopted in all types of image - 

20 capturing devices that employ an image - capturing element 
constituted of a plurality of pixels each having a 
photoelectric conversion element and provided in a matrix. 
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